-- Logs begin at Tue 2022-03-08 14:08:33 UTC, end at Tue 2022-03-08 15:36:51 UTC. -- Mar 08 14:36:28.193141 dv-cinder-830095-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 08 14:36:28.200330 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 14:36:28 2022] *** Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: nodename: dv-cinder-830095-2-iscsi Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: machine: x86_64 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: clock source: unix Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: pcre jit disabled Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: detected number of CPU cores: 4 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: current working directory: / Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: detected binary path: /usr/bin/uwsgi-core Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: your processes number limit is 47680 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: your memory page size is 4096 bytes Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: detected max file descriptor number: 2048 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: lock engine: pthread robust mutexes Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: thunder lock: enabled Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 08 14:36:28.205621 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 14:36:28.251716 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: Python main interpreter initialized at 0x555f0dc649c0 Mar 08 14:36:28.251716 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: python threads support enabled Mar 08 14:36:28.251716 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: your server socket listen backlog is limited to 100 connections Mar 08 14:36:28.251716 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: your mercy for graceful operations on workers is 90 seconds Mar 08 14:36:28.252074 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 14:36:28.252137 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: *** Operational MODE: preforking *** Mar 08 14:36:28.252415 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: *** uWSGI is running in multiple interpreter mode *** Mar 08 14:36:28.252415 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: spawned uWSGI master process (pid: 91143) Mar 08 14:36:28.252622 dv-cinder-830095-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 08 14:36:28.253443 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: spawned uWSGI worker 1 (pid: 91156, cores: 1) Mar 08 14:36:28.253539 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: spawned uWSGI worker 2 (pid: 91157, cores: 1) Mar 08 14:36:28.253679 dv-cinder-830095-2-iscsi devstack@keystone.service[91143]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 14:36:34.082599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:36:34.082599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: from cryptography.utils import int_from_bytes Mar 08 14:36:34.083398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:36:34.083398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: from cryptography.utils import int_from_bytes Mar 08 14:36:34.083690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:36:34.083690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: from cryptography.utils import int_from_bytes Mar 08 14:36:34.084142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:36:34.084142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: from cryptography.utils import int_from_bytes Mar 08 14:36:34.128754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 14:36:34.129017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 14:36:34.129108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 14:36:34.129189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] command line args: [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 14:36:34.129260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 14:36:34.129420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] command line args: [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 14:36:34.129504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 14:36:34.129572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ================================================================================ {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 14:36:34.129630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 14:36:34.129800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ================================================================================ {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 14:36:34.129984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] admin_token = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] admin_token = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] config_dir = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] config_dir = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] config_source = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] debug = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] config_source = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] debug = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.130855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.131122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.131209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.131369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_config_append = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_dir = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_file = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.132966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.133921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_config_append = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.134899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_dir = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_file = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.135984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.136123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.136254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.136501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.136665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.136813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] publish_errors = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.136944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.137962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] standard_threads = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.138890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] use_journal = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] use_json = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] use_stderr = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.139865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.140006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] use_syslog = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.140136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.140263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.140396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.140538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.140538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.140538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.141085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.141085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] publish_errors = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.141379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.141548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.141686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.141827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.141997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.142141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.142141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.142392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.142520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.142654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.142790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] standard_threads = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.142930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.143061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.143194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.143329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.143457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.143602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.143742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.143873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] use_journal = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.143873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] use_json = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.144121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.144257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] use_stderr = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.144385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.144585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] use_syslog = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.144733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.144876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:36:34.145012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.145149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.145289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.145420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.145559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.145687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.145821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.146964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.147917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.148893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.149713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.150946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.151951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.152991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.153948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.154078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.154217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.154346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.154474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.154709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.155971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.156123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.156123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.157984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.158973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.159950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.160896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.161870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.162903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.163936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.164993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165788 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.165939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.166924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.167996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.168900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.external = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.169838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.password = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] auth.token = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.170972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.171959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.172677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.172878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.173898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.174885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.175984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.176909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.177948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.external = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.178899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179030 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.password = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] auth.token = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.179968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.180895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.181026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.181169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.181302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.181442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.181671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.181846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.182800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.183895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.184868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.185825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.186956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.187087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.187324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.187487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.187652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.187792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.187924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.188855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.189927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.190988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.191936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.192937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.193886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.194980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.195903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.196973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.197914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.198991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.199914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.200998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.201985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.202129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.202259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.202389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.202529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.202937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.203915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.204984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.205906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.206953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.207882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] role.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] role.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.208916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.209910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.210064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.210355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.210521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.210657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.210787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.210918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.211990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.212913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.213158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.213290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.213428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.213569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.213699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.213830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.214963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.215888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] role.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] role.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.216925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.217872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.218011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.218153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.218286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.218417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.218549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.218679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.219322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.219486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.219621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.219752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.219882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.220971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.221938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.222987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.connection = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.223917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.224991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.225956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.226987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.227918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.228859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.connection = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.230023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.231256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.232394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:36:34.232394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 14:36:34.246675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.246969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.247110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.248421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.248657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.248885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.256791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.258771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.288922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.289271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.292349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.292579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.348335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.348953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.399456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.399672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.400711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.401058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.467212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.467380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.467487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.467570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.467788 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.467929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.468015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.468206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.468411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.468734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.469688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.470037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.494844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.495109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.495323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.495412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.495551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.495770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.495938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.496023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.496189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.496431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.496756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.497074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.497389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.497705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.508743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.508935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.521717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.521991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.522219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.522442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.522525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.522661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.522877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.523034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.523118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.523427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.523754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.524076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.524389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.524702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 14:36:34.540353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.540527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.540625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 14:36:34.540886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.540970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 14:36:34.541092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 14:36:34.541360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.541572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.541664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.541885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.542068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 14:36:34.542151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.542518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.542883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.543243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.543604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.553454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.553727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.554017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.554298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.555653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.556041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.556421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.556824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.562255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.566240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.567218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.567496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.567889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.568172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.568458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.568721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.568993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.569269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.569542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.569817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.570112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.570714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.571098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.571592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.571982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.572373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.572741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.573121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.573520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.573923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.574307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.574681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.596535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.598159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.598439 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.601540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.603359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.603592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.603847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.603931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.604142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.609291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.610227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.610670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.611822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.612104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.616622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.616906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.617186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.617465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.617736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.618032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.618304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.618570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.619040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.619425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.624066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.624466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.624857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.625815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.626431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.626825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.627205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.627586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.637611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.637911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.643193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.646842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.647137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.647621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.648005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.652080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.652740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.655779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.656657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.657061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.659666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.659964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.660248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.660530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.660807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.661099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.662802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.666734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.670464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.670873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.671304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.671698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.672653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.673082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.680577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.680864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.681132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.681392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.690412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.692097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.692381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.694342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.694753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.695132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.695383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.695616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.695698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.695930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.696206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.696494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.704716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.706530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.706919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.710075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.710479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.710697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.711041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.711161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.711259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.711540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.711623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.711827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.712069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.712153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.712374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.726235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.726660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.727065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.727459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.727851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.728237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.728621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.731955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.735222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.738652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.740207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.741816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.742118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.742417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.749104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.752948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.756526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.758304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.760087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.760487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.760885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.851791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.853556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.856922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.857225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.857509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.857789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.867358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.867660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.867941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.876142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.876435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.876791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.877066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.877336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.877605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.877895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.878166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.878434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.878809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.879083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.879345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.879632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.879969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.880054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.881612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.884711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.885063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.885281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.885556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.898001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.898844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.899284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.908046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 14:36:34.908320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.908596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.908870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.909140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.909409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.909697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.909996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.910267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.910642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.910978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.911326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.911767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.912042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 14:36:34.917773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f0dc649c0 pid: 91157 (default app) Mar 08 14:36:34.921295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958610-8b77-43a5-b617-dedec4d1a03b None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:34.921596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958610-8b77-43a5-b617-dedec4d1a03b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:34.921903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958610-8b77-43a5-b617-dedec4d1a03b None None] PATH_INFO: `/v3` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:34.928352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Mar 8 14:36:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:34.951195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f0dc649c0 pid: 91156 (default app) Mar 08 14:36:43.330281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c253-8e02-4b83-ab9c-750ad9d4d105 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:43.330791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c253-8e02-4b83-ab9c-750ad9d4d105 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:43.330872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c253-8e02-4b83-ab9c-750ad9d4d105 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:43.332854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:43.340244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:43.340746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:43.340870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:43.371340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG oslo_db.sqlalchemy.engines [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:36:43.550948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG passlib.handlers.bcrypt [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91156) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 14:36:43.551348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG passlib.handlers.bcrypt [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91156) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 14:36:43.606573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:43.608092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:43.727180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 08 14:36:43.900210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c253-8e02-4b83-ab9c-750ad9d4d105 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:43.933635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG oslo_db.sqlalchemy.engines [None req-a4f9c253-8e02-4b83-ab9c-750ad9d4d105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:36:44.061817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c253-8e02-4b83-ab9c-750ad9d4d105 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:44.066740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:44.067410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:44.067699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:44.067978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:44.077812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:44.127640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 14:36:44.127984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48eeb-7765-471b-a88e-f72907cfba44 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:44.137180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Mar 8 14:36:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 14:36:44.143180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:44.158147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1ace6-ed93-40b7-a10c-eb9e21ec8a42 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:44.162799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:44.163915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:44.164203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:44.164477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] PATH_INFO: `/v3/projects/419bd55459f54e4a803dd03c0fde0573` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:44.166127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] RBAC: Authorizing `identity:get_project(project_id=419bd55459f54e4a803dd03c0fde0573)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:44.217917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.common.rbac_enforcer.enforcer [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 14:36:44.218256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80f7b-d470-4949-aa2f-0d6663282758 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:44.222893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 2/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Mar 8 14:36:44 2022] GET /identity/v3/projects/419bd55459f54e4a803dd03c0fde0573 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:46.552237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2210b3-336e-4538-a064-12c7a03b0509 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:46.552747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2210b3-336e-4538-a064-12c7a03b0509 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:46.552828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2210b3-336e-4538-a064-12c7a03b0509 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:46.557321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 4/6] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:46.562859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:46.563295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:46.563382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:46.582659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:46.584169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:46.591844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Mar 08 14:36:46.614520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2210b3-336e-4538-a064-12c7a03b0509 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:46.626392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2210b3-336e-4538-a064-12c7a03b0509 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:46.630564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07cb45-f78e-42bb-8ce3-36e04b4af8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:46.631190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07cb45-f78e-42bb-8ce3-36e04b4af8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:46.631476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07cb45-f78e-42bb-8ce3-36e04b4af8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:46.631755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07cb45-f78e-42bb-8ce3-36e04b4af8e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:46.639382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07cb45-f78e-42bb-8ce3-36e04b4af8e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:46.641875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07cb45-f78e-42bb-8ce3-36e04b4af8e1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:46.650488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Mar 8 14:36:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:36:46.655619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:46.665043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0c59-0b1b-487f-9eed-755fd2b984f4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:46.669381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2faec7-71a2-41b9-8693-ae41d6cb8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:46.670270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2faec7-71a2-41b9-8693-ae41d6cb8b03 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:46.670555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2faec7-71a2-41b9-8693-ae41d6cb8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:46.670831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2faec7-71a2-41b9-8693-ae41d6cb8b03 admin admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:46.672342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2faec7-71a2-41b9-8693-ae41d6cb8b03 admin admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:46.674283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2faec7-71a2-41b9-8693-ae41d6cb8b03 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:46.675824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 4/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Mar 8 14:36:46 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:49.039841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d79fa1-db2a-4f4d-989b-bdf76980ea26 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.040387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d79fa1-db2a-4f4d-989b-bdf76980ea26 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.040475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d79fa1-db2a-4f4d-989b-bdf76980ea26 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.042187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:49.048106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.048518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.048778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.065998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:49.067184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:49.104974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fddc2-fdbe-40c1-9c25-1156244595ae None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.105173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fddc2-fdbe-40c1-9c25-1156244595ae None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.105456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fddc2-fdbe-40c1-9c25-1156244595ae None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.107259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 7/11] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:36:49.112917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.113206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.113485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.144426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 5/12] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:36:49.152997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG passlib.handlers.bcrypt [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91157) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 14:36:49.153417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG passlib.handlers.bcrypt [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91157) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 14:36:49.168109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.201117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:49.203011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:49.262826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6206f-896f-4d12-a380-363a4cf4ec7c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.294877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.295676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.295960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.296238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.298768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 8/13] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:36:49.307733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:36:49.315079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:36:49.316453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 6/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:36:49.320147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.322040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.415681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c35c8-878d-46e2-8816-d80415bc4f9c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.418818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc631d-9849-4868-aeb0-d0b9e9a660c4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.448594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.449254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.449538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.449816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.450590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:49.450899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.452347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.454346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.455223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.455514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.455795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.463961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 7/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:49.470090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.519762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.521277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.561820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa5b6-81fe-497f-a90a-0bf3c931d640 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.593543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.594936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.595218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.595493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.596701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.598191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.599794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:49.605087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.614006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 9/17] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:36:49.619478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.697312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fcabb-9634-4e78-9897-965984e36b79 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.711408 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3fc0f-aa42-48bf-802b-9eea3272985b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.729637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.730464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.730748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.731019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.732204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.733661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.735304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:49.740906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.743015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.743807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.744087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.744361 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.762080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.763535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.780669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:36:49.782697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:36:49.788286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:49.833925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a28cb9-7039-4be3-8a1b-423474b88028 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.864725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.865375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.865653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.865958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.866771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.domain.id=default, user.id=0bd37b850c884d06a49d5c8c55a39f03) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:49.867080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.868525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474cb3e-d432-4d53-93fd-4715fd0c5a5e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.875431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/role_assignments?user.id=0bd37b850c884d06a49d5c8c55a39f03&scope.domain.id=default&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:49.883305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624e90e-4b80-4e0c-b8db-7708fa844e66 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:49.919826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:49.920492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:49.920774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:49.921049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:49.921966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:49.922410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:49.923837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb882e-7bc2-4ace-b084-34ace642699a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:49.947539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:52.638133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc207-5799-4835-8d43-09cd951694ff None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:52.638646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc207-5799-4835-8d43-09cd951694ff None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:52.638646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc207-5799-4835-8d43-09cd951694ff None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:52.641596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:52.646845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df05d-7ee4-463f-8d91-39ff6c046a6a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:52.647269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df05d-7ee4-463f-8d91-39ff6c046a6a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:52.647441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771df05d-7ee4-463f-8d91-39ff6c046a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:52.667741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-771df05d-7ee4-463f-8d91-39ff6c046a6a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:52.668963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-771df05d-7ee4-463f-8d91-39ff6c046a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:52.753823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:36:52.772176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1088-7cc2-49ad-b9ae-338b4b16874c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:52.772454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1088-7cc2-49ad-b9ae-338b4b16874c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:52.772732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1088-7cc2-49ad-b9ae-338b4b16874c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:52.774518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:52.779848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:52.780142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:52.780420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:52.784931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1088-7cc2-49ad-b9ae-338b4b16874c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:52.806310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:52.807507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:52.928831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:36:52.948235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1088-7cc2-49ad-b9ae-338b4b16874c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:52.974209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:52.996083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:52.996889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:52.997170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:52.997447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.017067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:53.018422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:53.037878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-a02a4120-4185-4e5f-9597-86744a7de41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:36:53.037878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 13/26] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:36:53.042547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00350-cbc1-4a11-a9bf-b3aefd59cbd0 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.042765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00350-cbc1-4a11-a9bf-b3aefd59cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.043047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00350-cbc1-4a11-a9bf-b3aefd59cbd0 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.045105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 14/27] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:53.045811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00350-cbc1-4a11-a9bf-b3aefd59cbd0 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:53.128631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f200f8f-ec56-434f-a466-bf66f7fb1691 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:53.169839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77ffef-6d6a-4643-9874-e74425ed97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:53.171061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77ffef-6d6a-4643-9874-e74425ed97fc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.171600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77ffef-6d6a-4643-9874-e74425ed97fc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.172618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77ffef-6d6a-4643-9874-e74425ed97fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.191823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00350-cbc1-4a11-a9bf-b3aefd59cbd0 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:53.195347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77ffef-6d6a-4643-9874-e74425ed97fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:36:53.209060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-3c77ffef-6d6a-4643-9874-e74425ed97fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:36:53.214420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 14/28] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:36:53.217678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.219519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.220018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.248471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:53.250116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:53.259646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:53.260581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.260581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.260870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.261565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:53.261879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:53.263280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:53.293339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 15/29] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:53.294359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:53.336641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:36:53.337868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:53.411203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3711c-57c4-4394-b374-ae76c9b348a7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:53.454939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:53.455547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.455830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.456103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.456876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:53.457168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:53.458613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:53.472729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 16/31] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:53.475687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:53.500248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069c12d-e071-472f-8843-a9efd0fb26c4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:53.539527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:53.540202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.540486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.540763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.541698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:53.543199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:53.598109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769343c8-ca7d-4ce0-87ec-ffdad40e3548 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:53.632352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db090921-234a-493b-b32b-11fcbcf40ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:53.633077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090921-234a-493b-b32b-11fcbcf40ba3 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.633361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090921-234a-493b-b32b-11fcbcf40ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.633632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090921-234a-493b-b32b-11fcbcf40ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.634407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db090921-234a-493b-b32b-11fcbcf40ba3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:53.635806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db090921-234a-493b-b32b-11fcbcf40ba3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:53.706307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 16/32] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:36:53 2022] POST /identity/v3/projects => generated 301 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:36:53.707461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:53.766843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 17/33] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Mar 8 14:36:53 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:36:53.768528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf727ae6-dae7-4c37-9186-7107aafc4a58 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.768828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf727ae6-dae7-4c37-9186-7107aafc4a58 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.769105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf727ae6-dae7-4c37-9186-7107aafc4a58 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.770912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 18/34] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:53.780574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.780949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.781230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.819038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:53.820722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:53.865839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20cd0-012e-4f08-929f-ac78e3f4149c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:53.938716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:53.939648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:53.939932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:53.940213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:53.942552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:53.949895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:53.949895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 17/35] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:36:53 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:53.956062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 19/36] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:36:53.957972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:54.050148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:54.102233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fff3be-5f34-4e2d-afb6-1123e7448a60 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:54.140793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:54.142056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.142492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.142912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.144471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:54.146147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:54.147943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 18/37] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:54.153842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:54.168048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133f144-148a-4f4e-af2a-1eb6cca745d9 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:54.207780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b889d-71f1-4a3a-8c55-1fb787259dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:54.208511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b889d-71f1-4a3a-8c55-1fb787259dbc None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.208740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b889d-71f1-4a3a-8c55-1fb787259dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.209017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b889d-71f1-4a3a-8c55-1fb787259dbc None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.209778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b889d-71f1-4a3a-8c55-1fb787259dbc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:54.211406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b889d-71f1-4a3a-8c55-1fb787259dbc None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:54.228837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 20/38] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Mar 8 14:36:54 2022] POST /identity/v3/roles => generated 225 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:36:54.248201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93f929-b0f7-4fc4-8acc-e6f557d06cb3 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.248580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93f929-b0f7-4fc4-8acc-e6f557d06cb3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.248863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93f929-b0f7-4fc4-8acc-e6f557d06cb3 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.251536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 21/39] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:36:54.259780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32201a2-1204-4cfd-8775-05f0d8dd2a71 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.260068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32201a2-1204-4cfd-8775-05f0d8dd2a71 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.260352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32201a2-1204-4cfd-8775-05f0d8dd2a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.268660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99df8-e874-49ef-8ad6-dc69565ff1d7 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:54.284328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c32201a2-1204-4cfd-8775-05f0d8dd2a71 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:54.285711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c32201a2-1204-4cfd-8775-05f0d8dd2a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:54.306478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:54.307637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.308073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.308562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] PATH_INFO: `/v3/domains/default/users/0bd37b850c884d06a49d5c8c55a39f03/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.310825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0bd37b850c884d06a49d5c8c55a39f03, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:54.313264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:54.337185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Mar 8 14:36:54 2022] PUT /identity/v3/domains/default/users/0bd37b850c884d06a49d5c8c55a39f03/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:36:54.402305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:36:54.427975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:54.447703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b5b65-2e0d-4857-83d0-4bdb90f7054e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.447992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b5b65-2e0d-4857-83d0-4bdb90f7054e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.448306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b5b65-2e0d-4857-83d0-4bdb90f7054e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.450248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 23/42] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:36:54.457610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.457936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.458201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.476453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:54.477676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:54.572628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:36:54.577355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a2aa9-59bc-4720-8689-35886e19b1bf None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:54.598245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:54.617406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:54.618297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.618583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.618852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.620025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:54.621487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:54.623138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 20/44] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:54.629219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:54.695652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8604df-51c2-4887-8e7a-7a9604dc6180 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:54.724821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09ed-d358-471f-85a0-138d1df51eb3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:54.728196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ea109-3519-4136-9b70-0e57677c4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:54.728820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea109-3519-4136-9b70-0e57677c4492 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.729109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea109-3519-4136-9b70-0e57677c4492 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.729393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea109-3519-4136-9b70-0e57677c4492 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.730239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ea109-3519-4136-9b70-0e57677c4492 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:54.731661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ea109-3519-4136-9b70-0e57677c4492 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:54.747588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 25/45] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Mar 8 14:36:54 2022] POST /identity/v3/roles => generated 223 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:36:54.760470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8b9d-cc12-4cc5-b11b-189c161d855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:54.761174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8b9d-cc12-4cc5-b11b-189c161d855f None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:54.761463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8b9d-cc12-4cc5-b11b-189c161d855f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:54.761750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8b9d-cc12-4cc5-b11b-189c161d855f None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:54.762518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb8b9d-cc12-4cc5-b11b-189c161d855f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:54.764055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb8b9d-cc12-4cc5-b11b-189c161d855f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:54.795891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 21/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:36:54 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:36:56.699257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a4d2-04f9-4f97-91b5-fb1b913f1464 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:56.699804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a4d2-04f9-4f97-91b5-fb1b913f1464 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:56.699804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a4d2-04f9-4f97-91b5-fb1b913f1464 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:56.701588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 26/47] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:56.707874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:56.708288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:56.708437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:56.724970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:56.726502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:56.791192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 22/48] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:36:56.815914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114a4d2-04f9-4f97-91b5-fb1b913f1464 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:56.915107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114a4d2-04f9-4f97-91b5-fb1b913f1464 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:56.954885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:56.955616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:56.955901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:56.956181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:56.968064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:36:56.975241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:36:56.976486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 27/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:36:56.982375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:57.075448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cf973-26ce-46d2-b7f0-58dd458be269 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:57.107163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:57.107840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.108127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.108405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.109694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:57.110020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:57.111405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13799932-c0fb-4b3d-b13c-831aafcf1001 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:57.123080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 23/50] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:57.129378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:57.177942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e058a-7c84-4613-9f01-cb8df60cdca6 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.178233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e058a-7c84-4613-9f01-cb8df60cdca6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.178511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e058a-7c84-4613-9f01-cb8df60cdca6 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.180420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 24/51] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:36:57.185019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.185310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.185593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.203410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:57.204595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:57.224955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cc3c3-85ab-4ea1-86c4-29673fbac87d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:57.256427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:57.257302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.257594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.257889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.259067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:57.260516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:57.262154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 28/52] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:36:57 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:36:57.267603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:57.268013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 25/53] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:36:57.290691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:57.360622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d2f57-af1a-4d90-9ce6-74d753714998 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:57.384667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95988b-b1a0-48fa-8298-7dfe12051280 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:57.392375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:57.393167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.393452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.393729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.394923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:57.396364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:57.397969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 29/54] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:57.403645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:57.417085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:57.417908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.418199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.418488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.419659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:57.421130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:57.422785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 26/55] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:36:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:57.428283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:36:57.496657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1357-f489-46a0-b4fe-0ad61545ee9e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:57.521182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ddb21-d841-4464-88f8-1da1107ed00d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:36:57.528368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:57.529020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.529301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.529577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.530423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.domain.id=default, user.id=0bd37b850c884d06a49d5c8c55a39f03) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:36:57.530732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:57.532273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24fee-009d-4260-a93c-db0d7a7297a9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:57.537709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 30/56] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Mar 8 14:36:57 2022] GET /identity/v3/role_assignments?user.id=0bd37b850c884d06a49d5c8c55a39f03&scope.domain.id=default&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 530 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:36:57.553597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2191-05b3-4611-843a-4505f7a22a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:36:57.554322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2191-05b3-4611-843a-4505f7a22a82 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:57.554616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2191-05b3-4611-843a-4505f7a22a82 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:57.554903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2191-05b3-4611-843a-4505f7a22a82 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:57.555653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2191-05b3-4611-843a-4505f7a22a82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:36:57.557168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2191-05b3-4611-843a-4505f7a22a82 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:36:57.584623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 27/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Mar 8 14:36:57 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:36:59.907254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372feb4-0d0c-4a51-9362-b7217bb90155 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:59.907784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372feb4-0d0c-4a51-9362-b7217bb90155 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:59.907784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372feb4-0d0c-4a51-9362-b7217bb90155 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:59.909586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 31/58] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:36:59.914772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:36:59.915143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:36:59.915335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:36:59.932774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:36:59.934004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:36:59.998723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 28/59] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:00.023202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372feb4-0d0c-4a51-9362-b7217bb90155 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:00.118095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372feb4-0d0c-4a51-9362-b7217bb90155 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:00.149616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2eef9-cfef-417d-82a5-5c3302e13710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:00.150429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2eef9-cfef-417d-82a5-5c3302e13710 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:00.150712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2eef9-cfef-417d-82a5-5c3302e13710 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:00.150984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2eef9-cfef-417d-82a5-5c3302e13710 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:00.152147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2eef9-cfef-417d-82a5-5c3302e13710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:00.153596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2eef9-cfef-417d-82a5-5c3302e13710 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:00.155188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 32/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:00.161836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:00.253983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907df8-d746-46dd-a7d8-b804e1c3ce5b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:00.286127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d488-07ec-4e95-bcb9-938b86c4cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:00.286793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d488-07ec-4e95-bcb9-938b86c4cebb None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:00.287083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d488-07ec-4e95-bcb9-938b86c4cebb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:00.287366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d488-07ec-4e95-bcb9-938b86c4cebb None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:00.288076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d488-07ec-4e95-bcb9-938b86c4cebb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:00.289562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d488-07ec-4e95-bcb9-938b86c4cebb None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:00.313805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 29/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:00 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:03.902755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd0eb0-0611-4b54-aba6-68dada45fc44 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:03.903262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd0eb0-0611-4b54-aba6-68dada45fc44 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:03.903333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd0eb0-0611-4b54-aba6-68dada45fc44 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:03.905763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 33/62] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:03.907734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b34e3-492d-487e-9b85-10d87578eab5 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:03.908170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b34e3-492d-487e-9b85-10d87578eab5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:03.908386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b34e3-492d-487e-9b85-10d87578eab5 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:03.910552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 30/63] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:03.911774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dda652-8301-4239-92df-c2b71a76577d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:03.912069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dda652-8301-4239-92df-c2b71a76577d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:03.912350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dda652-8301-4239-92df-c2b71a76577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:03.920433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:03.920729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:03.921009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:03.938500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c6dda652-8301-4239-92df-c2b71a76577d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:03.941883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c6dda652-8301-4239-92df-c2b71a76577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:03.949033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:03.953876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:04.059285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 34/64] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:04.060647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb8ce6-6e07-475c-b5a6-c0bcd05ed85e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.060935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb8ce6-6e07-475c-b5a6-c0bcd05ed85e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.061208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb8ce6-6e07-475c-b5a6-c0bcd05ed85e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.066565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 35/65] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:04.069902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.070199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.070482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.072642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 31/66] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:04.089489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:04.090795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:04.097833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.164877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 36/67] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:04.165961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.245795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de6348-2105-431b-a0e5-433a24c7e0db None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.275935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f29dc-b318-4b73-9047-e123a44fa3fd None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.289559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.290670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.291014 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.291301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.308046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:04.313414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5131e9-34c3-440f-b018-eca29a679671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.314263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5131e9-34c3-440f-b018-eca29a679671 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.314554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5131e9-34c3-440f-b018-eca29a679671 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.314837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5131e9-34c3-440f-b018-eca29a679671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.316309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:04.317810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 32/68] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:04.318840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.327587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5131e9-34c3-440f-b018-eca29a679671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:04.334869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ef5131e9-34c3-440f-b018-eca29a679671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:04.336228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 37/69] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:04.337301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7140d-2a7e-45d2-baec-ce34f150f446 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.337591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7140d-2a7e-45d2-baec-ce34f150f446 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.337891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7140d-2a7e-45d2-baec-ce34f150f446 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.339795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 38/70] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:04.340512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7140d-2a7e-45d2-baec-ce34f150f446 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.423360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9024d1-b4e5-4b0c-98fa-e32ca826f9ff None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.441950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7140d-2a7e-45d2-baec-ce34f150f446 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.456111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.456919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.457208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.457487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.468787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:04.476666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:04.477896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 33/71] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:04.478675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.479045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.479677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.479966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.480248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.481014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:04.481328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:04.482819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bea11-4e42-4784-8ab4-f1aa0942c2b2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:04.491298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 39/72] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:04.492548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ba61-804c-4cb9-bca4-aec3637d90c4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.492837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ba61-804c-4cb9-bca4-aec3637d90c4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.493119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ba61-804c-4cb9-bca4-aec3637d90c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.509264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-18a7ba61-804c-4cb9-bca4-aec3637d90c4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:04.510496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-18a7ba61-804c-4cb9-bca4-aec3637d90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:04.572465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 40/73] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:04.573774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59d8c-27a5-4921-8e43-a5645d9cbd9f None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.574095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59d8c-27a5-4921-8e43-a5645d9cbd9f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.574386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59d8c-27a5-4921-8e43-a5645d9cbd9f None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.576045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 41/74] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:04.581248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59d8c-27a5-4921-8e43-a5645d9cbd9f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.584237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36240-b50e-4b33-abdb-aa237a68c6aa None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.617083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.617750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.618140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.618423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.619166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:04.619475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:04.620899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:04.628902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 34/75] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:04.629755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.675837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59d8c-27a5-4921-8e43-a5645d9cbd9f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.707275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.707934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.708218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.708774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.709514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:04.709819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:04.711221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb750a-dde8-4d70-b519-7fde5faca395 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:04.719839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 42/76] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:04.721216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.721510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.721803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.730838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766c4c-9755-4f73-ab61-b4083fcf2cc6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.738277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:04.739452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:04.763480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.764362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.764650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.765082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.779212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:04.780682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:04.782398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 35/77] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:04.786901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.801545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 43/78] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:04.803513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.881539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015d978-4e16-42ab-aef7-5edd26b995e1 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.895499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847f9d-8c01-42ec-bffc-1bdf63b9bf88 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:04.914355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.915151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.915434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.915712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.916880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:04.918370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:04.919946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 36/79] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:04.920850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:04.927513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:04.928331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:04.928610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:04.928882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:04.930090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:04.931575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:04.933326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 44/80] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:04.934007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.019311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3c142-27b3-4e69-a88f-6f4974028a90 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.029584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305904e0-a705-4e7c-81f0-48a4c6eafa3b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.050905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.051789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.052078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.052360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.053574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.055067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.056680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 37/81] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:05.057445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.065171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.065811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.066159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.066435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.131071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.132570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.153479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4734-208f-4553-85b0-6c0283c5e79b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.185431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.186202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.186491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.186771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.197305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:05.204766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:05.205955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 38/82] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:05.206702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.228500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 45/83] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:05.229335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.302445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76585ff3-86af-47af-8937-497a47c434a8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.319740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa542-055a-42c4-8d31-3d2acfbff463 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.335239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.335909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.336196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.336475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.337189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.338683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.351163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.351977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.352268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.352586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.359589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 39/84] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:05 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:05.360409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.435975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.438453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.469444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc90854-827c-4a83-b13f-b44ea94e877a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.507049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.508039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.508327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.508608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.541438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 46/85] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:05.542355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.580375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.581913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.664803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6260-ee4b-48e1-a6b0-0952437d90b0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.686093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 40/86] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:05.686939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.702914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.703962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.704450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.704935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.705936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:05.706471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.708131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.717826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 47/87] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:05.719446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.789294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270fb56-fb8a-4fa7-be9a-e1d40a28bc34 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.819915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d077d5-b3ff-47a8-ba5c-ee86c26af6fe None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.824445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.825529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.826004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.826430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.828177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.829811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.831713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 41/88] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:05.832641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.854959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.855832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.856126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.856406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.857613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.859347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.861237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 48/89] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:05.865976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:05.942292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716fe37-5141-4f68-8799-ccd58efe26da None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.980738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:05.981163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2379be-5fb6-4598-b9eb-7a5946bf1114 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:05.982465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:05.982918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:05.983352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:05.986121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:05.987770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:05.994456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 42/90] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:05.995449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:06.022381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:06.023811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:06.024192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:06.024703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:06.026961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:06.029087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:06.031118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 49/91] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:06.031963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:06.102385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d657fdc-4062-414f-834b-c878d572459d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:06.145118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087107-c6b1-48a2-b0d0-bb51c706b7c7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:06.146044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:06.146809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:06.147328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:06.147688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:06.149336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] RBAC: Adding query filter params (role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=9bfc026c06624bf8a533e636baa46d35) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:06.149734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:06.151306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:06.161209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 43/92] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:05 2022] GET /identity/v3/role_assignments?user.id=9bfc026c06624bf8a533e636baa46d35&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=24213b919d7548379490f689a4ceb95d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:06.162389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:06.183080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:06.184122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:06.184630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:06.185155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:06.186284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=9bfc026c06624bf8a533e636baa46d35) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:06.186913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:06.188674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:06.195153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 50/93] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:06 2022] GET /identity/v3/role_assignments?user.id=9bfc026c06624bf8a533e636baa46d35&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:06.196278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:06.353391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d490c-b5b2-4ddb-9a93-be7b82f3762d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:06.415775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4682-63c8-4859-8fc1-b7ae27a1577e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:06.427072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:06.428108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:06.428597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:06.429147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:06.430270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=0bd37b850c884d06a49d5c8c55a39f03) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:06.430800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:06.432573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:06.439690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 44/94] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:06 2022] GET /identity/v3/role_assignments?user.id=0bd37b850c884d06a49d5c8c55a39f03&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:06.491833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:06.492512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:06.492799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:06.493074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:06.581568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:06.583527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:06.690327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 51/95] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:06.696043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:06.841234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51877b-1af3-40fd-a643-3a36aab3d61e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:06.884964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6249d-3024-42c0-9781-c5e68e3adb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:06.885835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6249d-3024-42c0-9781-c5e68e3adb0b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:06.886148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6249d-3024-42c0-9781-c5e68e3adb0b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:06.886475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6249d-3024-42c0-9781-c5e68e3adb0b None admin] PATH_INFO: `/v3/projects/25bd09644d7847f3afaaa268fba04796` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:06.891164 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6249d-3024-42c0-9781-c5e68e3adb0b None admin] RBAC: Authorizing `identity:get_project(project_id=25bd09644d7847f3afaaa268fba04796)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:06.892641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6249d-3024-42c0-9781-c5e68e3adb0b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:06.894379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 45/96] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:06 2022] GET /identity/v3/projects/25bd09644d7847f3afaaa268fba04796 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:06.901887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:07.043454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3f552-0a8f-4a37-94aa-a0b72e4a6063 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:07.089495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:07.090554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:07.091043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:07.091593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:07.092622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=25bd09644d7847f3afaaa268fba04796, user.id=9bfc026c06624bf8a533e636baa46d35) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:07.093683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:07.095380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdd8d-199f-4948-ab8f-89dea65ffbe2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:07.101293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 52/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:06 2022] GET /identity/v3/role_assignments?user.id=9bfc026c06624bf8a533e636baa46d35&scope.project.id=25bd09644d7847f3afaaa268fba04796&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:08.578475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd189-2ae9-4e26-8e56-12402a1f424a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:08.579505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd189-2ae9-4e26-8e56-12402a1f424a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:08.580042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd189-2ae9-4e26-8e56-12402a1f424a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:08.582398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 46/98] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:08.587686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:08.588130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:08.588246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:08.611949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:08.613489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:08.699873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 53/99] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:08.740311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd189-2ae9-4e26-8e56-12402a1f424a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:08.871268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd189-2ae9-4e26-8e56-12402a1f424a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:08.912213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:08.913285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:08.913805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:08.914262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:08.925219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:08.932543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:08.933948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 47/100] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:08.942782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:09.076218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a01d5-4c62-442d-88b2-0b21875c2a29 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:09.113326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:09.114033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.114323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.114602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.115358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:09.115669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:09.117064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:09.130517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 54/101] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:09.139040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:09.285352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08864f2b-6a17-486a-a078-1b1c2360679e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:09.320247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e96a-f99b-4ecc-a5dc-33de89e0dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:09.321525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e96a-f99b-4ecc-a5dc-33de89e0dea0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.322052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e96a-f99b-4ecc-a5dc-33de89e0dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.322531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e96a-f99b-4ecc-a5dc-33de89e0dea0 None admin] PATH_INFO: `/v3/users/d59a350f0b994d8ea1de0e569c5700eb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.340199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e96a-f99b-4ecc-a5dc-33de89e0dea0 None admin] RBAC: Authorizing `identity:get_user(user_id=d59a350f0b994d8ea1de0e569c5700eb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:09.342022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e96a-f99b-4ecc-a5dc-33de89e0dea0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:09.344568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 48/102] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:09 2022] GET /identity/v3/users/d59a350f0b994d8ea1de0e569c5700eb => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:09.350164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:09.438342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e48f-88e0-4a75-9f29-874ddb7d63b2 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.438945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e48f-88e0-4a75-9f29-874ddb7d63b2 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.439438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e48f-88e0-4a75-9f29-874ddb7d63b2 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.441399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 49/103] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:09.451018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97dc57-6ce2-4ac2-83a9-f4471613ea7a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.451561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97dc57-6ce2-4ac2-83a9-f4471613ea7a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.452035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97dc57-6ce2-4ac2-83a9-f4471613ea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.487333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2df57-6719-4fea-8609-353b60b5611e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:09.494871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2e97dc57-6ce2-4ac2-83a9-f4471613ea7a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:09.496188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2e97dc57-6ce2-4ac2-83a9-f4471613ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:09.529791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e652cb-a3b7-42c9-a0bb-1a54f096f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:09.531390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e652cb-a3b7-42c9-a0bb-1a54f096f63a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.531902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e652cb-a3b7-42c9-a0bb-1a54f096f63a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.532377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e652cb-a3b7-42c9-a0bb-1a54f096f63a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.627538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 50/104] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:09.633873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9793-4d9e-46b0-8fcf-d4a183c4a496 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.634401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9793-4d9e-46b0-8fcf-d4a183c4a496 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.634842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9793-4d9e-46b0-8fcf-d4a183c4a496 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.636791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 51/105] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:09.651952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.652704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.653322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.654977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e652cb-a3b7-42c9-a0bb-1a54f096f63a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:09.661875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e652cb-a3b7-42c9-a0bb-1a54f096f63a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:09.683308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:09.684856 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:09.755689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 52/106] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:09.761878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:09.773786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 55/107] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:09.775476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0602-4a9e-4904-bc73-124817bde4de None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.775938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0602-4a9e-4904-bc73-124817bde4de None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.776370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0602-4a9e-4904-bc73-124817bde4de None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.778662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 56/108] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:09.783787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0602-4a9e-4904-bc73-124817bde4de None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:09.874339 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4018f07-7612-47d7-8c97-9b802ad84836 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:09.884475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0602-4a9e-4904-bc73-124817bde4de None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:09.907360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb71c-3a7d-493a-94be-72eac6e4ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:09.908266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb71c-3a7d-493a-94be-72eac6e4ae89 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.908553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb71c-3a7d-493a-94be-72eac6e4ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.908828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb71c-3a7d-493a-94be-72eac6e4ae89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.918934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccb71c-3a7d-493a-94be-72eac6e4ae89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:09.922779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc13e0e-2277-492a-9a10-e19c77eed94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:09.923697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13e0e-2277-492a-9a10-e19c77eed94e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.923978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13e0e-2277-492a-9a10-e19c77eed94e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.924298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13e0e-2277-492a-9a10-e19c77eed94e None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.925529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc13e0e-2277-492a-9a10-e19c77eed94e None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:09.926661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-5bccb71c-3a7d-493a-94be-72eac6e4ae89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:09.927190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc13e0e-2277-492a-9a10-e19c77eed94e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:09.932985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 53/109] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:09.933113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 57/110] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:09 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:09.933207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.933207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.933207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.933400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b99b6-a1fb-46d4-b186-b41de2821281 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:09.933400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b99b6-a1fb-46d4-b186-b41de2821281 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:09.933400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b99b6-a1fb-46d4-b186-b41de2821281 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:09.933400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 58/111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:09.933400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b99b6-a1fb-46d4-b186-b41de2821281 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:09.953989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:09.955202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:10.029975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 54/112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:10.029975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.038698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b99b6-a1fb-46d4-b186-b41de2821281 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.073337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.074165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.074450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.074726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.075901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.077707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.083927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 59/113] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.083927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.136153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1682-229d-49a3-bfdb-6921866cd91f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.176870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.177563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.177877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.178324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.178970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:10.179222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.180613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333251-e070-488a-8fd4-51c600ecc925 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.183772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f765ce-38ad-4aac-913d-11aec9ae96f0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.189966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 55/114] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.191057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.191350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.191632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.208590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:10.209785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:10.226548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.227205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.227484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.227759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.228570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] RBAC: Adding query filter params (role.id=248a233a9b5f4c9fa2bcce523d5f43fd, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=d59a350f0b994d8ea1de0e569c5700eb) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:10.228879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.230370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.236119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 60/115] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/role_assignments?user.id=d59a350f0b994d8ea1de0e569c5700eb&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=248a233a9b5f4c9fa2bcce523d5f43fd => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.236535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.304376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 56/116] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:10.306787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.373098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9349f-fc78-472d-8893-103d24e367d5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.414500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.415455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.415788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.416069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.429397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:10.437408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:10.438749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 61/117] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:10.439626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.454688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7173be2-1ca9-42e7-9caa-eba78072325f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.490061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.490792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.491086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.491372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.492089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.493594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.522630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 57/118] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:37:10 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:10.524321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.566277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cecab7-494b-454b-9d01-0cf9e722f42f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.606628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.607537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.607962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.608246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.614486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.616074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.618060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 62/119] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.618932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.659102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af66cf-da43-4266-8b62-b3b7fe44e5a7 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.699457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8799-73f0-4c99-9e5b-b48b49a735de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.700544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8799-73f0-4c99-9e5b-b48b49a735de None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.700983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8799-73f0-4c99-9e5b-b48b49a735de None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.701411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8799-73f0-4c99-9e5b-b48b49a735de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.713835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee8799-73f0-4c99-9e5b-b48b49a735de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:10.721959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-caee8799-73f0-4c99-9e5b-b48b49a735de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:10.723383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 58/120] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:10.724889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214668-4625-4433-8c75-0ca354fbc948 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.725329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214668-4625-4433-8c75-0ca354fbc948 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.725866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214668-4625-4433-8c75-0ca354fbc948 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.727691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 59/121] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:10.728657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99214668-4625-4433-8c75-0ca354fbc948 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.742238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ed185-a3e3-4859-8a11-77849c7f67ac None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.787371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.792035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.792035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.792035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.792035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:10.792035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.792035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.801008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 63/122] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.801904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.844224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99214668-4625-4433-8c75-0ca354fbc948 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.877624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91eb85-64b2-41c0-9463-d86ea7708525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.878526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91eb85-64b2-41c0-9463-d86ea7708525 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.878810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91eb85-64b2-41c0-9463-d86ea7708525 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.879085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91eb85-64b2-41c0-9463-d86ea7708525 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.880274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91eb85-64b2-41c0-9463-d86ea7708525 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.881731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91eb85-64b2-41c0-9463-d86ea7708525 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.883434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 60/123] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.884743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.885178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.885631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.903916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:10.905324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:10.911121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0923-38b0-4b10-b3b0-2922e4cd4000 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:10.955417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:10.956344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:10.956805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:10.957237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:10.958222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:10.958872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:10.960492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:10.969341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 64/124] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:10.970464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:10.977697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 61/125] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:10.986410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.076344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d802-8aa2-40d9-ae98-54da3caf78b1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.110927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.112167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.112657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.113132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.114570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.116254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.117215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92505f-937f-4dd3-b449-427cbd8c0df3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.122905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 65/126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:10 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:11.123966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.155146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.157007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.157300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.157585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/9bfc026c06624bf8a533e636baa46d35/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.160016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf399969d7b3447cb1c476a26351da2e, user_id=9bfc026c06624bf8a533e636baa46d35, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.162375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.178580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 62/127] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:10 2022] PUT /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/9bfc026c06624bf8a533e636baa46d35/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:11.182292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.259382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347fe8-0dfe-4a78-99d6-3a881488a49a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.307748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.309040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.309529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.310053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.313454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.315301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.319197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 66/128] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:11 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:11.322599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.405989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad34079-724d-4762-ba60-a63c23460ca7 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.444337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.445535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.446078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.446617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.460838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:11.468690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:11.470224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 63/129] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:11.471006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f262-8a91-44d3-b88c-7938527766c1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.471698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.515272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.516518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.517025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.517521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.519023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.520705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.522683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 67/130] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:11 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:11.526858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.582761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0cd0-c7c6-4640-8b4f-c54396944ceb None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.616912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.617801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.618113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.618393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.619581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.621115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.622979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 64/131] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:11 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:11.623740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.631090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cceb05-02ac-4321-a2e3-75ac1348cd78 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.674709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.675778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.676317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.676796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.677749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:11.679409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.682567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.701194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 68/132] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:11.705207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.796865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903bb15-8291-4de7-80af-b4f9ca31a25b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.841114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.842410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.843480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.844091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/9bfc026c06624bf8a533e636baa46d35/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.848709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf399969d7b3447cb1c476a26351da2e, user_id=9bfc026c06624bf8a533e636baa46d35, role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.851606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.883057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 65/133] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:11 2022] PUT /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/9bfc026c06624bf8a533e636baa46d35/roles/24213b919d7548379490f689a4ceb95d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:11.884404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:11.908938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf8e7-53d1-4f43-9a1b-54188fe00c44 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:11.960967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:11.961964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:11.962253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:11.962530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/0bd37b850c884d06a49d5c8c55a39f03/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:11.967255 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=cf399969d7b3447cb1c476a26351da2e, user_id=0bd37b850c884d06a49d5c8c55a39f03, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:11.969315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:11.997263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:11 2022] PUT /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/0bd37b850c884d06a49d5c8c55a39f03/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:12.025393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30ce25-1bc8-4bcb-8352-6ad6470c8d74 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:12.064047 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:12.064944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:12.065227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:12.065510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:12.066757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:12.068320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:12.070071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 66/135] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:11 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:12.077051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:12.205237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b56753-c133-4aa9-9e76-a806aea53bcd None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:12.241599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4547-bd0d-4119-bfcc-e44339d18f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:12.243006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4547-bd0d-4119-bfcc-e44339d18f99 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:12.243468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4547-bd0d-4119-bfcc-e44339d18f99 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:12.243977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4547-bd0d-4119-bfcc-e44339d18f99 None admin] PATH_INFO: `/v3/projects/25bd09644d7847f3afaaa268fba04796` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:12.245463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4547-bd0d-4119-bfcc-e44339d18f99 None admin] RBAC: Authorizing `identity:get_project(project_id=25bd09644d7847f3afaaa268fba04796)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:12.247246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4547-bd0d-4119-bfcc-e44339d18f99 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:12.249291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 70/136] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:12 2022] GET /identity/v3/projects/25bd09644d7847f3afaaa268fba04796 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:12.255690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:12.394451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47fd20-ac9a-4427-917d-9a1948624833 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:12.436279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988a663-d382-4376-80ec-d5b23ac95436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:12.438387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a663-d382-4376-80ec-d5b23ac95436 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:12.438679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a663-d382-4376-80ec-d5b23ac95436 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:12.438962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988a663-d382-4376-80ec-d5b23ac95436 None admin] PATH_INFO: `/v3/projects/25bd09644d7847f3afaaa268fba04796/users/9bfc026c06624bf8a533e636baa46d35/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:12.441037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988a663-d382-4376-80ec-d5b23ac95436 None admin] RBAC: Authorizing `identity:create_grant(project_id=25bd09644d7847f3afaaa268fba04796, user_id=9bfc026c06624bf8a533e636baa46d35, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:12.442556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988a663-d382-4376-80ec-d5b23ac95436 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:12.466967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 67/137] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:12 2022] PUT /identity/v3/projects/25bd09644d7847f3afaaa268fba04796/users/9bfc026c06624bf8a533e636baa46d35/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:13.367182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ebfb-4d93-4d25-a186-36a21d5583a3 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:13.368173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ebfb-4d93-4d25-a186-36a21d5583a3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:13.368651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ebfb-4d93-4d25-a186-36a21d5583a3 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:13.371061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 71/138] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:13.376978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7982-fae6-480d-af37-507a08b77fa3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:13.377873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7982-fae6-480d-af37-507a08b77fa3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:13.378365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7982-fae6-480d-af37-507a08b77fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:13.397097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b30a7982-fae6-480d-af37-507a08b77fa3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:13.398903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b30a7982-fae6-480d-af37-507a08b77fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:13.478361 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 68/139] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:13.502583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2ebfb-4d93-4d25-a186-36a21d5583a3 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:13.505225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d2ca-ca69-4b67-b989-78ddef1dcc41 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:13.505723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d2ca-ca69-4b67-b989-78ddef1dcc41 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:13.506241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d2ca-ca69-4b67-b989-78ddef1dcc41 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:13.508255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 69/140] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:13.520255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:13.520843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:13.521320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:13.547463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:13.548646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:13.615758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 70/141] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:13.665159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:13.710564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2ebfb-4d93-4d25-a186-36a21d5583a3 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:13.783523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:13.784337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:13.784637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:13.784917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:13.821889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:13.826311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:13.827871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 72/142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:13.838798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:13.846392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a44b-3978-4fb0-a25f-434e27a01371 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:13.906590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81570a5-03af-4369-baac-252ac003682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:13.907826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81570a5-03af-4369-baac-252ac003682a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:13.908314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81570a5-03af-4369-baac-252ac003682a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:13.908789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81570a5-03af-4369-baac-252ac003682a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:13.910255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81570a5-03af-4369-baac-252ac003682a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:13.911938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81570a5-03af-4369-baac-252ac003682a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:13.913751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 71/143] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:13.923789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81570a5-03af-4369-baac-252ac003682a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:14.037722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81570a5-03af-4369-baac-252ac003682a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:14.088234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:14.088947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.089237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.089521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.091990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:14.094033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:14.104491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e2c0f-08b4-48a7-8f2f-179f0125c1dc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:14.143800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 72/144] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:13 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:37:14.174750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:14.175351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.175636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.175912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.176670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:14.176980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:14.178419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:14.191644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 73/145] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:14.197811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:14.349121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6ccf3-78be-4c0a-949e-6c3416064a2b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:14.393511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:14.395245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.395765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.396242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] PATH_INFO: `/v3/users/d59a350f0b994d8ea1de0e569c5700eb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.397753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] RBAC: Authorizing `identity:get_user(user_id=d59a350f0b994d8ea1de0e569c5700eb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:14.399455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:14.401614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 73/146] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:14 2022] GET /identity/v3/users/d59a350f0b994d8ea1de0e569c5700eb => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:14.407626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:14.564631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341bdc-b39a-421a-8b8b-f696be71c5a5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:14.609079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648401-2ec0-4adc-80c0-e7e97b6b5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:14.609950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648401-2ec0-4adc-80c0-e7e97b6b5afe None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.610233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648401-2ec0-4adc-80c0-e7e97b6b5afe None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.610514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648401-2ec0-4adc-80c0-e7e97b6b5afe None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.611751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9648401-2ec0-4adc-80c0-e7e97b6b5afe None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:14.613216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9648401-2ec0-4adc-80c0-e7e97b6b5afe None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:14.614933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 74/147] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:14 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:14.620993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:14.724552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1812d0-2f09-44bf-8c25-3e6edec421ef None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.724876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1812d0-2f09-44bf-8c25-3e6edec421ef None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.725125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1812d0-2f09-44bf-8c25-3e6edec421ef None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.726999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 75/148] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:14.732283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.732448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.732723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.753895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:14.753895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:14.768573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a50438-5517-4b59-a209-a7d6352dcbdd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:14.814080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:14.815767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:14.816248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:14.816729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/d59a350f0b994d8ea1de0e569c5700eb/roles/248a233a9b5f4c9fa2bcce523d5f43fd` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:14.818971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf399969d7b3447cb1c476a26351da2e, user_id=d59a350f0b994d8ea1de0e569c5700eb, role_id=248a233a9b5f4c9fa2bcce523d5f43fd)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:14.821110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:14.850782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 74/149] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:14 2022] PUT /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e/users/d59a350f0b994d8ea1de0e569c5700eb/roles/248a233a9b5f4c9fa2bcce523d5f43fd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:14.857699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 76/150] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:14.909117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:15.048584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81aacc8-808b-458e-b8b4-9f412a26e649 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:15.092697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:15.094327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.094831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.095308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.106705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:15.115139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:15.116781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 75/151] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:15.123041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:15.254231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b5d8e-83ce-4091-b635-94088b5a5541 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:15.297701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:15.298756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.299237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.299710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.300684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:15.301209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:15.302823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb4d7e-14db-4d0a-9da3-efde0fdc3c03 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:15.312069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 77/152] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:15.317331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:15.350709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5de00-07de-42f3-b7c5-8090dd8dbad3 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.351318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5de00-07de-42f3-b7c5-8090dd8dbad3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.351808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5de00-07de-42f3-b7c5-8090dd8dbad3 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.353788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 78/153] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:15.359242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.359827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.360321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.386975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:15.388188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:15.459708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049627e-daa6-425f-93d9-a20a045bf130 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:15.499787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:15.501142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.501640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.502161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.503946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:15.505804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:15.507707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 76/154] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:15 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:15.513410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:15.560223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 79/155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:15.602817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:15.622003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae7cc1-5d82-4126-bbbc-5ab1495a71f6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:15.664913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47d89-c4bf-45fc-a346-94d40cb1e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:15.666401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47d89-c4bf-45fc-a346-94d40cb1e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.666897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47d89-c4bf-45fc-a346-94d40cb1e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.667377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47d89-c4bf-45fc-a346-94d40cb1e1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.729295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cdbe-41ea-4329-b78d-5a511b7567ba None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:15.757981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d47d89-c4bf-45fc-a346-94d40cb1e1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:15.760468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d47d89-c4bf-45fc-a346-94d40cb1e1b7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:15.768279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fda1ee-d6f3-4df0-beba-9e02fdc9537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:15.769414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fda1ee-d6f3-4df0-beba-9e02fdc9537c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.769978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fda1ee-d6f3-4df0-beba-9e02fdc9537c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.770491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fda1ee-d6f3-4df0-beba-9e02fdc9537c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.782116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fda1ee-d6f3-4df0-beba-9e02fdc9537c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:15.790778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-46fda1ee-d6f3-4df0-beba-9e02fdc9537c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:15.792269 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 80/156] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:15.793843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca3b0-3d1f-4f07-b7e6-5d24d90bb7a0 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.794368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca3b0-3d1f-4f07-b7e6-5d24d90bb7a0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.794932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca3b0-3d1f-4f07-b7e6-5d24d90bb7a0 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.797563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 81/157] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:15.802721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca3b0-3d1f-4f07-b7e6-5d24d90bb7a0 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:15.873212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 77/158] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:15.875076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.875587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.876082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.895410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:15.896923 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:15.919572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca3b0-3d1f-4f07-b7e6-5d24d90bb7a0 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:15.988436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:15.989172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:15.989457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:15.989737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:15.990550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:15.990859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:15.992503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:15.993896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 78/159] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:15.994799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.008540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 82/160] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:16.014571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.126645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb15edf-b04e-4722-82fa-17b8367f0a94 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.166935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:16.167814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.168097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.168375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.170087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:16.172162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:16.174086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 79/161] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:15 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:16.177563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.240601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87149-4b0b-4f78-8f4b-dd4bbf91d3b7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.289150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:16.294165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.294464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.294749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.296073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:16.297961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:16.300984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 83/162] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:16 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:16.302299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.317884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e166a-26ab-4725-8e56-5714bd441912 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.360582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:16.361458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.361741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.363238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.387340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:16.395395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:16.396863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 80/163] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:16.402754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.525319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b8ebf-4ac4-409a-9064-a6c89d074a5e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.541429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98c51-ab3b-47bc-ab43-b706a0313ea5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.560340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77b4e3-4f0e-46ee-abf2-20c03e4b0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:16.560995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77b4e3-4f0e-46ee-abf2-20c03e4b0364 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.561288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77b4e3-4f0e-46ee-abf2-20c03e4b0364 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.562132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77b4e3-4f0e-46ee-abf2-20c03e4b0364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.623923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:16.625745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.625745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.625951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.629347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=9bfc026c06624bf8a533e636baa46d35) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:16.629347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:16.629347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:16.631904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77b4e3-4f0e-46ee-abf2-20c03e4b0364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:16.633437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77b4e3-4f0e-46ee-abf2-20c03e4b0364 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:16.642269 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 84/164] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:16 2022] GET /identity/v3/role_assignments?user.id=9bfc026c06624bf8a533e636baa46d35&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:16.643493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.739114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 81/165] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:16.740448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacc8de-f655-4165-a439-94ef4dde45f9 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.740744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacc8de-f655-4165-a439-94ef4dde45f9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.741024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacc8de-f655-4165-a439-94ef4dde45f9 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.743003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 82/166] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:16.746594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacc8de-f655-4165-a439-94ef4dde45f9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:16.861224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacc8de-f655-4165-a439-94ef4dde45f9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.900051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd4ed-7381-4add-969b-d0597a47664b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:16.901117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace91e9-8a8d-4fd9-87aa-e4b5a0dcd585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:16.902205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace91e9-8a8d-4fd9-87aa-e4b5a0dcd585 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.902494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace91e9-8a8d-4fd9-87aa-e4b5a0dcd585 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.903647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace91e9-8a8d-4fd9-87aa-e4b5a0dcd585 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.904954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace91e9-8a8d-4fd9-87aa-e4b5a0dcd585 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:16.907126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace91e9-8a8d-4fd9-87aa-e4b5a0dcd585 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:16.909293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 83/167] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:16 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:16.911289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:16.911584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:16.911868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:16.931549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:16.932808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:17.013251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:17.015323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.020170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.020857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.021134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.021403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.023074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:17.023430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.027755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.049468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 85/169] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:17.054052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.164871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ace71-2edb-4c58-85df-3e358e2ac34f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.203845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.204791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.205083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.205362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.206238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] RBAC: Adding query filter params (role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=9bfc026c06624bf8a533e636baa46d35) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:17.206556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.208204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.215003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 85/170] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/role_assignments?user.id=9bfc026c06624bf8a533e636baa46d35&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=24213b919d7548379490f689a4ceb95d => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:17.215905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.286769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6b9c8-e668-4982-b86e-41d2760979cd None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.331847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87fff-aa47-4b56-b1db-783e4a6aa64e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.362591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.363491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.363769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.364042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] PATH_INFO: `/v3/users/0bd37b850c884d06a49d5c8c55a39f03` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.365308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] RBAC: Authorizing `identity:get_user(user_id=0bd37b850c884d06a49d5c8c55a39f03)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.366925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.368657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 86/171] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/users/0bd37b850c884d06a49d5c8c55a39f03 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:17.373624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.374585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.374886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.375243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.377209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.389250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:17.398665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:17.400122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 86/172] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:17.406523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.516691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788eaf9-edc3-4fa4-a866-1dac30aa7803 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.531473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521aa2d-01aa-4b17-a0e3-b69ceafd9330 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.551319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.551996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.552286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.552565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.553327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:17.553639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.555076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.564844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 87/173] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:17.570526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.578385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.579067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.579350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.579624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.677891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a42c70-9463-4768-946b-5f19782f1992 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.711100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.711998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.712284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.712566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] PATH_INFO: `/v3/users/9bfc026c06624bf8a533e636baa46d35` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.718242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] RBAC: Authorizing `identity:get_user(user_id=9bfc026c06624bf8a533e636baa46d35)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.718242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.720540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 88/174] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/users/9bfc026c06624bf8a533e636baa46d35 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:17.724278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.724726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:17.726451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.835566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b690-0aa1-41d1-8a50-444805179d7a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:17.872993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:17.873776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:17.874860 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:17.875223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:17.949431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:17.951532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:17.985454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 87/175] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:18.007330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:18.064379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 89/176] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:18.070249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:18.181191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4891245-dbf9-48fb-9524-4e6e52f33d5b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:18.220014 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:18.221158 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:18.221587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:18.222065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] PATH_INFO: `/v3/projects/25bd09644d7847f3afaaa268fba04796` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:18.224337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] RBAC: Authorizing `identity:get_project(project_id=25bd09644d7847f3afaaa268fba04796)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:18.226243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:18.228609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 90/177] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:18 2022] GET /identity/v3/projects/25bd09644d7847f3afaaa268fba04796 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:18.243569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:18.254748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6c7dc-bb4b-407b-b1af-41391f77df16 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:18.304498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:18.305728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:18.306253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:18.306721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:18.314605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:18.316210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:18.318379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 88/178] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:18 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:18.325340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:18.362659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb67e2-dd0e-44fb-bc6d-3f3ba57f534d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:18.456983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:18.457570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:18.457868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:18.458154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:18.459003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=25bd09644d7847f3afaaa268fba04796, user.id=9bfc026c06624bf8a533e636baa46d35) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:18.459318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:18.460767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4159-beb5-477c-b784-70fa37eb5b50 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:18.475891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 91/179] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:18 2022] GET /identity/v3/role_assignments?user.id=9bfc026c06624bf8a533e636baa46d35&scope.project.id=25bd09644d7847f3afaaa268fba04796&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:18.522180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac4419-d984-456b-b43f-cf32016dd2c9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:18.567953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:18.568628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:18.568907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:18.569182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:18.570051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=0bd37b850c884d06a49d5c8c55a39f03) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:18.570360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:18.571830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cfad1-174b-40ab-88c7-e4d9327a0a4c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:18.579653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 89/180] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:18 2022] GET /identity/v3/role_assignments?user.id=0bd37b850c884d06a49d5c8c55a39f03&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:18.891452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346712-b473-4beb-a4d2-b4cc4730d403 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:18.891993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346712-b473-4beb-a4d2-b4cc4730d403 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:18.891993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18346712-b473-4beb-a4d2-b4cc4730d403 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:18.893877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 92/181] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:18.899722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:18.900179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:18.900380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:18.924755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:18.926530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:19.025369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 90/182] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:19.050102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18346712-b473-4beb-a4d2-b4cc4730d403 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.166678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18346712-b473-4beb-a4d2-b4cc4730d403 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.208385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813b24-c196-43c2-9db1-ff1f56b97ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.209482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813b24-c196-43c2-9db1-ff1f56b97ac1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.209971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813b24-c196-43c2-9db1-ff1f56b97ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.210418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813b24-c196-43c2-9db1-ff1f56b97ac1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.225266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813b24-c196-43c2-9db1-ff1f56b97ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:19.232769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-3d813b24-c196-43c2-9db1-ff1f56b97ac1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:19.234604 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 93/183] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:19.240068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.276473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6651-43fc-46cb-be09-a4bf6e851d1d None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.276759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6651-43fc-46cb-be09-a4bf6e851d1d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.277041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6651-43fc-46cb-be09-a4bf6e851d1d None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.278876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 94/184] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:19.285035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.285319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.285599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.305297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:19.306563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:19.351335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dca6d5-fdb2-4592-8c4a-d8914ff6ead2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.391311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.392308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.392671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.393048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.393929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:19.394403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 95/185] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Mar 08 14:37:19.394527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:19.395856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18c8c-44b2-43aa-99bc-7af39f23efc5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:19.405990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 91/186] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:19.411791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.415429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb80450-d488-432f-a00d-5b673d1420e2 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.416062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb80450-d488-432f-a00d-5b673d1420e2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.416062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb80450-d488-432f-a00d-5b673d1420e2 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.418260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 92/187] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:19.425707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb80450-d488-432f-a00d-5b673d1420e2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.515811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc749f48-5b60-41cb-b3ab-ae26b4006c71 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.518782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb80450-d488-432f-a00d-5b673d1420e2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.549334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809af00-2f60-48e7-bee8-e1116a70db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.550251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809af00-2f60-48e7-bee8-e1116a70db98 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.550540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809af00-2f60-48e7-bee8-e1116a70db98 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.550809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809af00-2f60-48e7-bee8-e1116a70db98 None admin] PATH_INFO: `/v3/users/d59a350f0b994d8ea1de0e569c5700eb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.551117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.551904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.552079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809af00-2f60-48e7-bee8-e1116a70db98 None admin] RBAC: Authorizing `identity:get_user(user_id=d59a350f0b994d8ea1de0e569c5700eb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:19.552172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.552440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.553472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809af00-2f60-48e7-bee8-e1116a70db98 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:19.559926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 96/188] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/users/d59a350f0b994d8ea1de0e569c5700eb => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:19.559926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.559926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.559926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.564728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:19.571856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:19.573232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 93/189] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:19.574857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.575329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:19.576507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:19.642765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 97/190] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:19.643824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.678259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdb351-23e5-4faa-b264-d5deeef45d75 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.712242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438da8-c866-41bf-9d97-368d75c9dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.713150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438da8-c866-41bf-9d97-368d75c9dfef None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.713579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438da8-c866-41bf-9d97-368d75c9dfef None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.714042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438da8-c866-41bf-9d97-368d75c9dfef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.740217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d194fe-14b3-4be9-9366-0bb64035726b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.772779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.773446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.773728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.774040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.774779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:19.775090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:19.776479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:19.778480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438da8-c866-41bf-9d97-368d75c9dfef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:19.779950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438da8-c866-41bf-9d97-368d75c9dfef None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:19.784609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 98/191] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:19.785559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.873119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 94/192] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:19.874499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7969-93e2-4688-954c-d25b97aeb63a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.874868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7969-93e2-4688-954c-d25b97aeb63a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.875153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e7969-93e2-4688-954c-d25b97aeb63a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.876840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 95/193] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:19.877979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7969-93e2-4688-954c-d25b97aeb63a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.884172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836175-df69-4cff-a653-a925b0c0d33c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:19.915839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:19.916629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:19.916905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:19.917177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:19.918347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:19.919779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:19.922110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 99/194] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:19.922863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:19.973899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e7969-93e2-4688-954c-d25b97aeb63a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.005996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8cc4d-6f72-48a4-abc2-09b14414112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.006870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8cc4d-6f72-48a4-abc2-09b14414112f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.007148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8cc4d-6f72-48a4-abc2-09b14414112f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.007418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8cc4d-6f72-48a4-abc2-09b14414112f None admin] PATH_INFO: `/v3/users/d03c9e345358467cac153ed9eb89d26d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.020586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8cc4d-6f72-48a4-abc2-09b14414112f None admin] RBAC: Authorizing `identity:get_user(user_id=d03c9e345358467cac153ed9eb89d26d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.021193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e310e-2cce-47c5-9794-4bf7fe7fab4c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.022081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8cc4d-6f72-48a4-abc2-09b14414112f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.023716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 96/195] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/users/d03c9e345358467cac153ed9eb89d26d => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:20.027134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.027418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.027688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.043116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:20.044285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:20.052463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.053324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.053605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.053899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.055075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.056517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.058218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 100/196] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:19 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:20.058958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.107130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 97/197] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:20.108174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.167559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4151-d937-4200-9d3f-7eb29b06bf60 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.199188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.199792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.200074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae626a0-b598-40e2-aee5-3b6b1e5ef3c1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.200170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.200346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.201039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.203064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.222731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 101/198] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:20 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:20.223735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.236100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.237188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.237473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.237748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.308547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.310094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.330383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ec93b-5cd1-4cc7-be35-28e28c940bc0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.364973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.365642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.365950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.366225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.367049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] RBAC: Adding query filter params (role.id=248a233a9b5f4c9fa2bcce523d5f43fd, scope.project.id=cf399969d7b3447cb1c476a26351da2e, user.id=d59a350f0b994d8ea1de0e569c5700eb) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:20.367653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.369139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.375759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 102/199] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/role_assignments?user.id=d59a350f0b994d8ea1de0e569c5700eb&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=248a233a9b5f4c9fa2bcce523d5f43fd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:20.377329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.417498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 98/200] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:20.424470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.495369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b2de5-144c-4ef5-9ce2-8f970a00597f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.532533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.533379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.533668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.533975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.538505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae6972-9026-4382-b803-88e768808bd1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.545586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:20.554794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:20.556251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 103/201] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:20.563782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.579861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.581131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.581652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.582158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.583665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.585350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.587365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 99/202] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:20.594146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.677740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990134d4-e384-4f69-bcce-8016fe42cf5f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.699881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cc99b-19e1-47ae-a1aa-ae75a601e6a2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.714798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.715788 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.716248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.716698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.718185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:20.719386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.720981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.732436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 104/203] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:20.736852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.737522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.737797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.738098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.738462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:20.738921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=d03c9e345358467cac153ed9eb89d26d) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:20.739224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.740677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.747318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 100/204] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/role_assignments?user.id=d03c9e345358467cac153ed9eb89d26d&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:20.854409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99001-9e98-4c16-ad31-ab64a1b62752 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:20.892676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:20.893913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:20.894396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:20.894862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] PATH_INFO: `/v3/users/d03c9e345358467cac153ed9eb89d26d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:20.896327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] RBAC: Authorizing `identity:get_user(user_id=d03c9e345358467cac153ed9eb89d26d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:20.898072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:20.900003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 105/205] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/users/d03c9e345358467cac153ed9eb89d26d => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:20.907634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:21.013557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1336f-474b-4707-be3b-dcf661c6720f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:21.049418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:21.050098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:21.050383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:21.050655 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:21.117081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:21.118619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:21.218635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 101/206] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:21.224369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:21.325885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c12b1-5d0b-4729-a898-d955c4af4c49 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:21.359819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f1c06-b687-4408-8160-1bff0787ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:21.360696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1c06-b687-4408-8160-1bff0787ebef None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:21.360981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1c06-b687-4408-8160-1bff0787ebef None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:21.361260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1c06-b687-4408-8160-1bff0787ebef None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:21.362489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1c06-b687-4408-8160-1bff0787ebef None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:21.363941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1c06-b687-4408-8160-1bff0787ebef None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:21.365791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 106/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:21 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:21.371478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:21.471416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628e47-11bb-4aa6-87f3-dcc0ad18c30c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:21.506242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:21.506914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:21.507199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:21.507479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:21.508306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] RBAC: Adding query filter params (role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=d03c9e345358467cac153ed9eb89d26d) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:21.508623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:21.510111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b1fbd-042e-4b3a-9e43-f79dcaa1f22e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:21.516642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 102/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:21 2022] GET /identity/v3/role_assignments?user.id=d03c9e345358467cac153ed9eb89d26d&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=24213b919d7548379490f689a4ceb95d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:22.798216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee75cb-099c-46c6-8ded-2ce092a74d08 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:22.798785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee75cb-099c-46c6-8ded-2ce092a74d08 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:22.798785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee75cb-099c-46c6-8ded-2ce092a74d08 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:22.800585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 107/209] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:22.806836 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:22.807338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:22.807580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:22.825633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:22.826946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:22.878082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4a13-9209-4de8-a1c3-7cf847fc08da None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:22.878380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4a13-9209-4de8-a1c3-7cf847fc08da None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:22.878639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c4a13-9209-4de8-a1c3-7cf847fc08da None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:22.880548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 108/210] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:22.885574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:22.885881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:22.886172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:22.895512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 103/211] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:22.903574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:22.904759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:22.919400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:22.983547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 109/212] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:23.008068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.021619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d0dc-adff-48a3-9925-cb96d3146f11 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.056934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.057654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.057962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.058231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.069771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:23.077447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:23.079480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 104/213] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:23.085380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.107114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2761a4-291d-4df8-9959-33af61ad0dc3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.141158 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.142000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.142284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.142559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.143737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.145185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.146816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 110/214] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:23.152297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.190332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f74d-9913-43c6-bf4e-ec0b30bd23ec None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.224489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.225489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.225995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.226478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.227444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:23.227819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.229209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb94bf5-fe97-4acc-bc3c-a039e5ebcc75 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.240567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 105/215] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:23.246389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6a64-917a-4488-9d45-1324db319301 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.246675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6a64-917a-4488-9d45-1324db319301 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.246948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a6a64-917a-4488-9d45-1324db319301 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.248606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 106/216] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:23.252741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6a64-917a-4488-9d45-1324db319301 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.260684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e617-b6f7-4918-a285-26209c0868c9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.295873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc986e-260e-4b89-aad1-ed5142d26657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.296660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc986e-260e-4b89-aad1-ed5142d26657 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.296965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc986e-260e-4b89-aad1-ed5142d26657 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.297242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc986e-260e-4b89-aad1-ed5142d26657 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.297979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc986e-260e-4b89-aad1-ed5142d26657 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.299436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc986e-260e-4b89-aad1-ed5142d26657 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.329975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 111/217] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:23 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:23.329975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.329975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.329975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.347131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:23.348337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:23.357671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a6a64-917a-4488-9d45-1324db319301 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.397075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.398252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.398669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.398961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] PATH_INFO: `/v3/users/0a32f6f2cdff48348095321e3fe8db37` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.416619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] RBAC: Authorizing `identity:get_user(user_id=0a32f6f2cdff48348095321e3fe8db37)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.418618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.420187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 112/218] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:23.426286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 107/219] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/users/0a32f6f2cdff48348095321e3fe8db37 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:23.428567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.445886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.550861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c108a-38d3-4c9e-bf9a-e2a8108d5a9c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.554365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81fa66-80d9-4bac-99be-970b964a4e6e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.593155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.594133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.595206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.595206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.595206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.595428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.595428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.595810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.609306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:23.616641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:23.617890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 108/220] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:23.623647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.679309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.680783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.759439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c65942-ae6d-4a6f-8309-ea2713552f7f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.805071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 113/221] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:23.808316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.809519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.810031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.810504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.810693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.812946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:23.813707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.815351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.824235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 109/222] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:23.831265 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.915401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fda1b-3bf3-4808-bc7b-7abc89828d32 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.934429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e74b0-492c-44ed-b3e9-e05ac9464b66 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:23.953693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019aa1c-f0d0-417b-8dc8-d6fd91046469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.953693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019aa1c-f0d0-417b-8dc8-d6fd91046469 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.953693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019aa1c-f0d0-417b-8dc8-d6fd91046469 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.953693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019aa1c-f0d0-417b-8dc8-d6fd91046469 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.954072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019aa1c-f0d0-417b-8dc8-d6fd91046469 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.955412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019aa1c-f0d0-417b-8dc8-d6fd91046469 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.961906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 114/223] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:23.963243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922a0b-b121-4265-aa2a-37888e1da2b6 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.963532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922a0b-b121-4265-aa2a-37888e1da2b6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.963810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922a0b-b121-4265-aa2a-37888e1da2b6 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.965637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 115/224] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:23.966535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922a0b-b121-4265-aa2a-37888e1da2b6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:23.972399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709593b6-5788-4bfd-a7e6-ea48be3d39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:23.973288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709593b6-5788-4bfd-a7e6-ea48be3d39ea None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.973571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709593b6-5788-4bfd-a7e6-ea48be3d39ea None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.973846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709593b6-5788-4bfd-a7e6-ea48be3d39ea None admin] PATH_INFO: `/v3/users/d03c9e345358467cac153ed9eb89d26d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.975079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709593b6-5788-4bfd-a7e6-ea48be3d39ea None admin] RBAC: Authorizing `identity:get_user(user_id=d03c9e345358467cac153ed9eb89d26d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:23.976541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709593b6-5788-4bfd-a7e6-ea48be3d39ea None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:23.978193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 110/225] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/users/d03c9e345358467cac153ed9eb89d26d => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:23.979348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:23.979632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:23.979907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:23.997610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:23.998897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:24.066602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 111/226] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:24.067551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:24.071805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922a0b-b121-4265-aa2a-37888e1da2b6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.105478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.106173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.106451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.106725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.107546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=0a32f6f2cdff48348095321e3fe8db37) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:24.107851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:24.110309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:24.115911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 116/227] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:23 2022] GET /identity/v3/role_assignments?user.id=0a32f6f2cdff48348095321e3fe8db37&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:24.122820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:24.181690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5223f01-eed9-4259-8ace-7fc10a779d2a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.216869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.217929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.218125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.218396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.219590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:24.221056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:24.222855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 112/228] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:24 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:24.235222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:24.300714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1f1a8-6879-4a03-bd8f-b6fa4a08f440 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.341126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.342740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.343297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.343833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.356549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:24.366163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:24.368193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 117/229] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:24.378846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:24.436907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8467ff2-e028-44e3-b165-18a1d3572aaf None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.503879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.505116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.505587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.506057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/d03c9e345358467cac153ed9eb89d26d/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.508280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10, user_id=d03c9e345358467cac153ed9eb89d26d, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:24.509317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7cb6-f479-454d-a4f7-eea51a8e2e36 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.510241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:24.536707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 113/230] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:24 2022] PUT /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/d03c9e345358467cac153ed9eb89d26d/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:37:24.545541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.547865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.548453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.549003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.550278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:24.550660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:24.552168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:24.561634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 118/231] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:24.568048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:24.684740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec994f-284e-475a-9b28-28555e617849 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.729563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.730503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.730788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.731064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] PATH_INFO: `/v3/users/d03c9e345358467cac153ed9eb89d26d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.732331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=d03c9e345358467cac153ed9eb89d26d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:24.734218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:24.735676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 114/232] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:24 2022] GET /identity/v3/users/d03c9e345358467cac153ed9eb89d26d => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:24.741407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:24.860369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b08cf-21a5-4012-9b22-6099ba9c7fb2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:24.901232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392c731-c910-4726-9358-6dd07ce0180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:24.902478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392c731-c910-4726-9358-6dd07ce0180c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:24.903065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392c731-c910-4726-9358-6dd07ce0180c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:24.903577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392c731-c910-4726-9358-6dd07ce0180c None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:24.905001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392c731-c910-4726-9358-6dd07ce0180c None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:24.907282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392c731-c910-4726-9358-6dd07ce0180c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:24.909463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 119/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:24 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:24.915431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:25.034572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845482f5-9a39-4d8b-bd5a-b07142916fd5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:25.073255 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2151a8-0b81-48e1-b4b5-5d0dfe0f889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:25.074180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2151a8-0b81-48e1-b4b5-5d0dfe0f889c None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:25.074463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2151a8-0b81-48e1-b4b5-5d0dfe0f889c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:25.074737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2151a8-0b81-48e1-b4b5-5d0dfe0f889c None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/d03c9e345358467cac153ed9eb89d26d/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:25.077490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2151a8-0b81-48e1-b4b5-5d0dfe0f889c None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10, user_id=d03c9e345358467cac153ed9eb89d26d, role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:25.078895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2151a8-0b81-48e1-b4b5-5d0dfe0f889c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:25.109801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 115/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:24 2022] PUT /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/d03c9e345358467cac153ed9eb89d26d/roles/24213b919d7548379490f689a4ceb95d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:26.357572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a9bc-6df9-4a92-aee2-12bd9bfeb0b0 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:26.358612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a9bc-6df9-4a92-aee2-12bd9bfeb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:26.358744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390a9bc-6df9-4a92-aee2-12bd9bfeb0b0 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:26.360708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 120/235] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:26.366222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536483-8564-4fdf-acec-4562e6910f7c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:26.366670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536483-8564-4fdf-acec-4562e6910f7c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:26.366844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536483-8564-4fdf-acec-4562e6910f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:26.384740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-eb536483-8564-4fdf-acec-4562e6910f7c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:26.385966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-eb536483-8564-4fdf-acec-4562e6910f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:26.457964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 116/236] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:26.477752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a9bc-6df9-4a92-aee2-12bd9bfeb0b0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:26.488570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406b76a-4b84-4f49-954f-fc655e525128 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:26.488860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406b76a-4b84-4f49-954f-fc655e525128 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:26.489138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406b76a-4b84-4f49-954f-fc655e525128 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:26.491228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 117/237] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:26.496132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:26.496426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:26.496708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:26.525997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:26.527197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:26.593763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390a9bc-6df9-4a92-aee2-12bd9bfeb0b0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:26.631841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:26.632708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:26.632989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:26.633260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:26.644398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:26.652181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:26.653569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 121/238] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:26.660804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:26.700496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 118/239] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:26.737577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:26.778113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980358-b806-4ca8-b81d-12051cf8bfc0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:26.816127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:26.816807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:26.817087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:26.817362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:26.818144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:26.818452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:26.819835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:26.837974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 122/240] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:26.859706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:26.949929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80ac9-2af1-45d9-b291-2b667d2806eb None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.002602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7416-1b20-43dc-882c-ee0db4af8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.003399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7416-1b20-43dc-882c-ee0db4af8d51 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.003674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7416-1b20-43dc-882c-ee0db4af8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.003941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7416-1b20-43dc-882c-ee0db4af8d51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.005157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7416-1b20-43dc-882c-ee0db4af8d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.006963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7416-1b20-43dc-882c-ee0db4af8d51 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.008913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 119/241] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:27.010308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136e65-82aa-4051-bc93-c3b813e52f14 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.010593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136e65-82aa-4051-bc93-c3b813e52f14 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.010867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136e65-82aa-4051-bc93-c3b813e52f14 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.012488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 120/242] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:27.017665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136e65-82aa-4051-bc93-c3b813e52f14 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.024855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d4153-460b-4e69-8239-7bf10a244d44 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.066746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1900273-3340-4f4d-910a-d9ce1fba7ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.067881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1900273-3340-4f4d-910a-d9ce1fba7ca8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.068162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1900273-3340-4f4d-910a-d9ce1fba7ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.068585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1900273-3340-4f4d-910a-d9ce1fba7ca8 None admin] PATH_INFO: `/v3/users/cafa7513fff7463b9139f22da9791f06` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.086632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1900273-3340-4f4d-910a-d9ce1fba7ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=cafa7513fff7463b9139f22da9791f06)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.088284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1900273-3340-4f4d-910a-d9ce1fba7ca8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.090916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 123/243] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:26 2022] GET /identity/v3/users/cafa7513fff7463b9139f22da9791f06 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:27.096460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.096755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.097034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.114217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:27.115450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:27.121253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136e65-82aa-4051-bc93-c3b813e52f14 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.158190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.159314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.159793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.160259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.161259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.163024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.182923 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 124/244] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:27.183690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.193756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 121/245] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:27 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:27.211291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.294016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd63c9-33be-41af-8c52-dc3824989d48 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.315817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1915c6-37a8-4980-9783-1fd991db1a25 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.333738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.334442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.334724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.335000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.398406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.399465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.399744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.400016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.408240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.409723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.425036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:27.432365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:27.433792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 122/246] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:27.441389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.513997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 125/247] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:27.520441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.579355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad661c3-a77d-4860-b2eb-559bb210b7c1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.617079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.617797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.618112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.618385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.619185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:27.619493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.620885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.631509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 123/248] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:27.637463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.638136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ae5ed-5caf-46ca-a844-1c2531f299cc None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.682837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.684320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.684602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.684878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.686656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.688506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.690829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 126/249] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:27.697677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.762665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c538-c48d-4347-a7c9-2952caf643d9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.805298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918605c-eab5-4fac-a5db-fbd9a7db0716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.806743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918605c-eab5-4fac-a5db-fbd9a7db0716 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.806743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918605c-eab5-4fac-a5db-fbd9a7db0716 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.806743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918605c-eab5-4fac-a5db-fbd9a7db0716 None admin] PATH_INFO: `/v3/users/0a32f6f2cdff48348095321e3fe8db37` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.808030 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918605c-eab5-4fac-a5db-fbd9a7db0716 None admin] RBAC: Authorizing `identity:get_user(user_id=0a32f6f2cdff48348095321e3fe8db37)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.809503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918605c-eab5-4fac-a5db-fbd9a7db0716 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.811284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 124/250] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/users/0a32f6f2cdff48348095321e3fe8db37 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:27.812453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ef83-59c2-4893-b803-d539225fc550 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.812734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ef83-59c2-4893-b803-d539225fc550 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.813005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ef83-59c2-4893-b803-d539225fc550 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.819160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 125/251] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:27.820164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ef83-59c2-4893-b803-d539225fc550 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:27.835984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa6ab3-76a1-4640-b69d-994e015f11f3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.877531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:27.877531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.877531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.877531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.878169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] RBAC: Adding query filter params (role.id=248a233a9b5f4c9fa2bcce523d5f43fd, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=cafa7513fff7463b9139f22da9791f06) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:27.878453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:27.880099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f8e7-857c-4c94-aa9b-1a2cf2b90b97 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:27.887092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 127/252] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/role_assignments?user.id=cafa7513fff7463b9139f22da9791f06&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=248a233a9b5f4c9fa2bcce523d5f43fd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:27.888363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:27.888653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:27.888930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:27.909593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:27.910852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:27.982644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ef83-59c2-4893-b803-d539225fc550 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:27.996118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 128/253] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:28.020673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.058498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.059619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.060049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.060466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.063810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:28.065455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:28.069331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 126/254] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:27 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:28.075954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.166188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb499-00a0-43c1-8d95-55d58e41463e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.220318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aa5a2-4b5e-49be-b615-aa51b21f1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.221140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aa5a2-4b5e-49be-b615-aa51b21f1658 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.221400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aa5a2-4b5e-49be-b615-aa51b21f1658 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.221669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aa5a2-4b5e-49be-b615-aa51b21f1658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.228011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38734da-86bd-4dcd-8118-1c78d695240e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.241228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336aa5a2-4b5e-49be-b615-aa51b21f1658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:28.256818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-336aa5a2-4b5e-49be-b615-aa51b21f1658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:28.258409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 129/255] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:28.259663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d7c4-72c7-4f74-a53f-8ecf222a4fd9 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.263868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d7c4-72c7-4f74-a53f-8ecf222a4fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.263868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939d7c4-72c7-4f74-a53f-8ecf222a4fd9 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.267272 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 130/256] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:28.268307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d7c4-72c7-4f74-a53f-8ecf222a4fd9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.270331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7c538-0954-4fcf-a153-cc574fa842cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.271400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7c538-0954-4fcf-a153-cc574fa842cd None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.271818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7c538-0954-4fcf-a153-cc574fa842cd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.272236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7c538-0954-4fcf-a153-cc574fa842cd None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/0a32f6f2cdff48348095321e3fe8db37/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.274421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7c538-0954-4fcf-a153-cc574fa842cd None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10, user_id=0a32f6f2cdff48348095321e3fe8db37, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:28.276048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7c538-0954-4fcf-a153-cc574fa842cd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:28.291120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 127/257] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:28 2022] PUT /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/0a32f6f2cdff48348095321e3fe8db37/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:28.292786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.293259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.293790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.314284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:28.315891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:28.389159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 128/258] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:28.413604 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939d7c4-72c7-4f74-a53f-8ecf222a4fd9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.416982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.505564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.506275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.506560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.506832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.507591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:28.507958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:28.509452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:28.529335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 131/259] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:28.535313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.575890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8353ab-71d8-4c69-bec4-0b7b34c3d6c7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.616085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.616915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.617193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.617465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.629184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:28.638214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:28.640275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 129/260] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:28.646110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.720639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed3034-9d40-45ba-985d-38a278bd0398 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.760371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.761262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.761543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.761819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] PATH_INFO: `/v3/users/d03c9e345358467cac153ed9eb89d26d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.765825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] RBAC: Authorizing `identity:get_user(user_id=d03c9e345358467cac153ed9eb89d26d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:28.767292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:28.773306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 132/261] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/users/d03c9e345358467cac153ed9eb89d26d => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:28.774165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:28.853471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967ac6-ee94-4d7e-9e71-43a7b90080a5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.894072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed488-cbda-4a7d-837e-959614ecb5c0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:28.931159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.931811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.932091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.932539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.937561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:28.937561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:28.937561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:28.937561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:28.938175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:28.938175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:28.939078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:28.968189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 130/262] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:28.982839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:29.010609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:29.012070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:29.110532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 133/263] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:29.115576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:29.147382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b4af-2e76-42c8-870e-3eea0f56a87a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:29.238577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:29.239834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:29.240345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:29.240820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] PATH_INFO: `/v3/users/d03c9e345358467cac153ed9eb89d26d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:29.242705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] RBAC: Authorizing `identity:get_user(user_id=d03c9e345358467cac153ed9eb89d26d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:29.244430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:29.250122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345551da-ce26-4013-94b0-c8aad0b8d4f4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:29.250978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 131/264] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:28 2022] GET /identity/v3/users/d03c9e345358467cac153ed9eb89d26d => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:29.267290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:29.302670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:29.303909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:29.305042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:29.306274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:29.308517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:29.311091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:29.313629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 134/265] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:29 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:29.323628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:29.470624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59f43-8528-4295-a4a0-1c77037f2cfc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:29.550210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:29.551226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:29.551747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:29.552264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:29.564891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910e88-23d9-48b0-ba18-5c149bec747a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:29.628761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:29.629787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:29.630305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:29.630845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:29.631871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=d03c9e345358467cac153ed9eb89d26d) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:29.632388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:29.634081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:29.646694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 135/266] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:29 2022] GET /identity/v3/role_assignments?user.id=d03c9e345358467cac153ed9eb89d26d&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:29.684364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:29.685840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:29.820573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 132/267] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:29.826664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:29.993095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa80db-899e-4841-80af-a9ba5672a376 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:30.039459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574ba4-aaac-4470-a2aa-81416888f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:30.040712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574ba4-aaac-4470-a2aa-81416888f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:30.041197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574ba4-aaac-4470-a2aa-81416888f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:30.041675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574ba4-aaac-4470-a2aa-81416888f3c4 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:30.043100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574ba4-aaac-4470-a2aa-81416888f3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:30.044747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574ba4-aaac-4470-a2aa-81416888f3c4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:30.047851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 136/268] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:29 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:30.053792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:30.196365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02f812-bd64-4ee1-9945-bb3d3a61163f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:30.245866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:30.246533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:30.246830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:30.247059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:30.247878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] RBAC: Adding query filter params (role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=d03c9e345358467cac153ed9eb89d26d) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:30.248184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:30.250184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418c3a8-5251-4534-b3b8-332c28eb0c35 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:30.256407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 133/269] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:30 2022] GET /identity/v3/role_assignments?user.id=d03c9e345358467cac153ed9eb89d26d&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=24213b919d7548379490f689a4ceb95d => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:30.887033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71407e8-26d3-49c1-abde-78d51f6c95c3 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:30.888028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71407e8-26d3-49c1-abde-78d51f6c95c3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:30.888539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71407e8-26d3-49c1-abde-78d51f6c95c3 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:30.891310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 137/270] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:30.896914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0ae4-3cb8-4564-955c-05f60a0617d2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:30.897365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0ae4-3cb8-4564-955c-05f60a0617d2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:30.897544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0ae4-3cb8-4564-955c-05f60a0617d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:30.918352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-855b0ae4-3cb8-4564-955c-05f60a0617d2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:30.919527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-855b0ae4-3cb8-4564-955c-05f60a0617d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:31.020891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 134/271] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:31.047459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71407e8-26d3-49c1-abde-78d51f6c95c3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.074808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e6c2-3f90-4aec-b970-e9facfe93d8d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.075722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e6c2-3f90-4aec-b970-e9facfe93d8d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.076190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e6c2-3f90-4aec-b970-e9facfe93d8d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.078797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 135/272] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:31.083683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e44ba-58cb-446d-9e0e-8508ed0dbb91 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.084191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e44ba-58cb-446d-9e0e-8508ed0dbb91 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.084637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e44ba-58cb-446d-9e0e-8508ed0dbb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.102166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-826e44ba-58cb-446d-9e0e-8508ed0dbb91 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:31.103671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-826e44ba-58cb-446d-9e0e-8508ed0dbb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:31.154202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71407e8-26d3-49c1-abde-78d51f6c95c3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.190156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.191088 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 136/273] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:31.195003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420deda-27ce-4c08-86a5-e655e06b014e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.195003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420deda-27ce-4c08-86a5-e655e06b014e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.195003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420deda-27ce-4c08-86a5-e655e06b014e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.195240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.195240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.195358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 137/274] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:31.195503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.200409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.200699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.200977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.208490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:31.216323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:31.217922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 138/275] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:31.218731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.219597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:31.220783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:31.289306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 138/276] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:31.294736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.322459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbaef-1c2f-4604-9991-199594e287da None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.354262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.355054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.355343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.355617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.365281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:31.372389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:31.374079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 139/277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:31.374842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.395095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c9693-185b-46a9-bc93-1c305b9b700b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.430216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.430822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.431106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.431382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.432140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:31.432452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:31.433939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40718ff-364a-4107-a9d3-02cb8f4873fa None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:31.443833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 139/278] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:31.445195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb22535-be01-4b5e-9ef3-492baa59c970 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.445483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb22535-be01-4b5e-9ef3-492baa59c970 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.445758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb22535-be01-4b5e-9ef3-492baa59c970 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.447665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 140/279] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:31.448211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb22535-be01-4b5e-9ef3-492baa59c970 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.547800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb22535-be01-4b5e-9ef3-492baa59c970 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.579355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.580015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.580297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.580572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.581306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] RBAC: Adding query filter params (name=reader) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:31.581624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:31.583050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:31.588594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea9062-fa9a-40b1-bb40-d50c7828451c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.590951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 141/280] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:31.591567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.620657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ec2a-ce61-4eb4-8fb5-d80caec76a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.621457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ec2a-ce61-4eb4-8fb5-d80caec76a23 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.621745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ec2a-ce61-4eb4-8fb5-d80caec76a23 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.622058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ec2a-ce61-4eb4-8fb5-d80caec76a23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.623219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3ec2a-ce61-4eb4-8fb5-d80caec76a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:31.625222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3ec2a-ce61-4eb4-8fb5-d80caec76a23 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:31.626908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 140/281] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:31.628055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.628338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.628622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.644203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:31.645406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:31.688801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51029a08-a9de-44b5-8f78-bc412831d5db None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.707722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 141/282] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:31.708360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.721414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.722321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.722601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.722872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] PATH_INFO: `/v3/users/da633761bafa4a568307ec009572e863` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.739035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] RBAC: Authorizing `identity:get_user(user_id=da633761bafa4a568307ec009572e863)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:31.740527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:31.742367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 142/283] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/users/da633761bafa4a568307ec009572e863 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:31.742959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.803024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d34a-209b-4daa-acd1-d955367a9bb9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.836348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.836676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ae4a-217c-437c-86de-0fb0a6abf64a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.837226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.837507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.837782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] PATH_INFO: `/v3/users/cafa7513fff7463b9139f22da9791f06` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.838995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] RBAC: Authorizing `identity:get_user(user_id=cafa7513fff7463b9139f22da9791f06)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:31.840436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:31.842058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 142/284] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/users/cafa7513fff7463b9139f22da9791f06 => generated 297 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:31.847244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.869532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.870229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.870511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.870787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.871487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:31.872930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:31.892020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 143/285] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:31 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:31.892020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:31.948836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f63a7-d289-42ad-9244-7a0ff4d317bf None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:31.984838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:31.985650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:31.985959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:31.986238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:31.997176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:32.004504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:32.005753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 143/286] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:32.006647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:32.011685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaf63b-be1e-4be6-a604-ab26f8632b03 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.046890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.047562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.047843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.048142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.048945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, user.id=da633761bafa4a568307ec009572e863, scope.system=all) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:32.049258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.050782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.065894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 144/287] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Mar 8 14:37:31 2022] GET /identity/v3/role_assignments?user.id=da633761bafa4a568307ec009572e863&scope.system=all&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:32.065894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:32.130261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb629d46-6000-4251-a02e-bfd167a1c3e5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.183144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.184566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.184566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.184764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.185960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.187998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.190032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 144/288] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:32 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:32.195996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:32.204899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d4464-989a-40bb-b8e3-fa3a8ced3490 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.259751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.260425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.260702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.260973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.261720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:32.262058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.263445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.275244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 145/289] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:32.280484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:32.333628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1636f5-2cd1-4291-9836-b5d28fcb48e0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.368000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.368899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.369177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.369445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/cafa7513fff7463b9139f22da9791f06/roles/248a233a9b5f4c9fa2bcce523d5f43fd` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.371476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10, user_id=cafa7513fff7463b9139f22da9791f06, role_id=248a233a9b5f4c9fa2bcce523d5f43fd)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.372986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.392926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 145/290] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:37:32 2022] PUT /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/users/cafa7513fff7463b9139f22da9791f06/roles/248a233a9b5f4c9fa2bcce523d5f43fd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:37:32.402848 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeea8f-8a74-4829-aafc-3e904bc5bebc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.448313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.449129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.449406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.449682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] PATH_INFO: `/v3/users/0a32f6f2cdff48348095321e3fe8db37` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.452811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] RBAC: Authorizing `identity:get_user(user_id=0a32f6f2cdff48348095321e3fe8db37)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.455866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.457792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 146/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:32 2022] GET /identity/v3/users/0a32f6f2cdff48348095321e3fe8db37 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:32.463556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:32.594163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbdaff-4099-4bd5-adb1-502bd8a99f1e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.629507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.630290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.630546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.630821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.699746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.701122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.803921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 146/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:32.808973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:32.943945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9032bb-05c4-42f4-9ca5-3236bb64057d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:32.978165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31ce23-c213-4f9e-8d13-e17a93f6a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:32.979032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31ce23-c213-4f9e-8d13-e17a93f6a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:32.979311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31ce23-c213-4f9e-8d13-e17a93f6a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:32.979594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31ce23-c213-4f9e-8d13-e17a93f6a8e5 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:32.980761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31ce23-c213-4f9e-8d13-e17a93f6a8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:32.982235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31ce23-c213-4f9e-8d13-e17a93f6a8e5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:32.984984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 147/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:32 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:32.990715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:33.091531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d9a8f-8a68-4950-befc-2e48b62ccb3e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:33.135994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:33.136651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:33.136931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:33.137203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:33.138057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=0a32f6f2cdff48348095321e3fe8db37) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:33.138367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:33.140313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f687a-2362-4ca5-8d5a-2a72c747edd1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:33.150055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 147/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:32 2022] GET /identity/v3/role_assignments?user.id=0a32f6f2cdff48348095321e3fe8db37&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:34.683350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e21a9-0f9f-4b21-a384-212cee59d0ad None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.684439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e21a9-0f9f-4b21-a384-212cee59d0ad None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.685012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e21a9-0f9f-4b21-a384-212cee59d0ad None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.687619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 148/295] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:34.693155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ea19-15a4-4bda-a9f7-630afec65a7e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.694017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ea19-15a4-4bda-a9f7-630afec65a7e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.694502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ea19-15a4-4bda-a9f7-630afec65a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.712774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1323ea19-15a4-4bda-a9f7-630afec65a7e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:34.714341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1323ea19-15a4-4bda-a9f7-630afec65a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:34.756734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fc47-a14a-49bf-8d68-364cbd5d6834 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.756734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fc47-a14a-49bf-8d68-364cbd5d6834 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.756734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fc47-a14a-49bf-8d68-364cbd5d6834 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.756734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 149/296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:34.762645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.763423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.763723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.780472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:34.781675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:34.787364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 148/297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:34.788528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bbd47-bc70-4c58-bdfd-f0483946fe80 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.788817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bbd47-bc70-4c58-bdfd-f0483946fe80 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.789097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bbd47-bc70-4c58-bdfd-f0483946fe80 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.797950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 149/298] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:34.797950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858da9c-37c0-4716-9031-02366b039445 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.797950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858da9c-37c0-4716-9031-02366b039445 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.797950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858da9c-37c0-4716-9031-02366b039445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.813903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2858da9c-37c0-4716-9031-02366b039445 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:34.815087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2858da9c-37c0-4716-9031-02366b039445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:34.849221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 150/299] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:34.854795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:34.885899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 150/300] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:34.885899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858da9c-37c0-4716-9031-02366b039445 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:34.954459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bc702-2ac5-473b-989f-36690d97e100 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:34.988406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:34.989208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:34.989484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:34.989754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:34.990510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858da9c-37c0-4716-9031-02366b039445 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.000457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:35.007804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:35.013617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 151/301] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:35.013617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.028719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.029519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.029993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.030393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.031739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.033181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.034819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 151/302] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.038711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.106738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548dd6a-2f9b-44c9-850e-448fa71dea43 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.133397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6564822-6e3c-439f-b2c2-90eae39b0402 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.138344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.139780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.140062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.140338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.149931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:35.157145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:35.158367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 152/303] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:35.159577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.169079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.169727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.170038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.170885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.171829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:35.172133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.173490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915b327-741e-41f7-b558-031976eddd8f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.181531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 152/304] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.183070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43b9f-e429-41a2-ae89-9c2cb5cd1523 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.183350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43b9f-e429-41a2-ae89-9c2cb5cd1523 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.183627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43b9f-e429-41a2-ae89-9c2cb5cd1523 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.185384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 153/305] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:35.187545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43b9f-e429-41a2-ae89-9c2cb5cd1523 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.254095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1a09-44f0-45ee-9421-345da7cd58a0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.284396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43b9f-e429-41a2-ae89-9c2cb5cd1523 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.284545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.285051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.285325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.285590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] PATH_INFO: `/v3/groups` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.286291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.287727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.302665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 153/306] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Mar 8 14:37:35 2022] POST /identity/v3/groups => generated 229 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:35.303722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.318598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.319338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.319552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.319822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.320582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:35.320889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.322371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a8be8-9230-4cc6-aedb-563b891180b3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.332078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 154/307] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.333400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.333690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.334046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.355116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:35.356318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:35.408741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb03c-5344-4110-a6ce-9276cadbe963 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.433885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 155/308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:35.433885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.446600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.447502 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.447786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.448056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] PATH_INFO: `/v3/users/da633761bafa4a568307ec009572e863` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.449342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=da633761bafa4a568307ec009572e863)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.450872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.453365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 154/309] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/users/da633761bafa4a568307ec009572e863 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.463314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.549658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f790a76-6f4f-4f45-9db2-1a6b1bd063b7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.562873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481537bb-d84d-4853-8142-82a33ebafbf2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.582548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.583436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.583723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.584004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] PATH_INFO: `/v3/users/af9e58a7d81f41a282b695066ebdb5de` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.597592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.597778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] RBAC: Authorizing `identity:get_user(user_id=af9e58a7d81f41a282b695066ebdb5de)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.598517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.598802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.599078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] PATH_INFO: `/v3/system/users/da633761bafa4a568307ec009572e863/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.599240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.600562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da633761bafa4a568307ec009572e863, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.600918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 156/310] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/users/af9e58a7d81f41a282b695066ebdb5de => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.602291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.606173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.612446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 155/311] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Mar 8 14:37:35 2022] PUT /identity/v3/system/users/da633761bafa4a568307ec009572e863/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:35.618123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.722284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460fe34-b886-4cd9-945a-2bfe61610471 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.750124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b04c-4554-418b-a83d-fd331d278476 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.761145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.761729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.762066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.762344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.774284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:35.782525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:35.783960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 157/312] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:35.789763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:35.790832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.791730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.792014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.792290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.793123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] RBAC: Adding query filter params (role.id=248a233a9b5f4c9fa2bcce523d5f43fd, user.id=af9e58a7d81f41a282b695066ebdb5de, scope.system=all) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:35.793489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.795036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.801467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 156/313] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/role_assignments?user.id=af9e58a7d81f41a282b695066ebdb5de&scope.system=all&role.id=248a233a9b5f4c9fa2bcce523d5f43fd => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.906088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750187-84b6-455b-b2da-c35fe0adaf3e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:35.941971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:35.947640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:35.947640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:35.947640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:35.947640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:35.947640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:35.947640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:35.956121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 158/314] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:35.961637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:36.068677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff2a60-cdf1-457e-9fb0-4973cde92539 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:36.102227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:36.103528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:36.104027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:36.104530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] PATH_INFO: `/v3/users/cafa7513fff7463b9139f22da9791f06` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:36.105954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] RBAC: Authorizing `identity:get_user(user_id=cafa7513fff7463b9139f22da9791f06)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:36.107615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:36.110009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 157/315] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:35 2022] GET /identity/v3/users/cafa7513fff7463b9139f22da9791f06 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:36.121896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:36.215768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad679c-493f-441c-ac96-082ebb407d74 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:36.249576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:36.250271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:36.250557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:36.250839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:36.318501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:36.320020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:36.418955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 159/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:36.424524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:36.527335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3cb05-5e27-4edb-bfc9-0f931a5d1e78 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:36.561994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24080fd6-b68b-47be-84b4-5677154d8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:36.562869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24080fd6-b68b-47be-84b4-5677154d8db8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:36.563146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24080fd6-b68b-47be-84b4-5677154d8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:36.563417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24080fd6-b68b-47be-84b4-5677154d8db8 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:36.564615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24080fd6-b68b-47be-84b4-5677154d8db8 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:36.566116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24080fd6-b68b-47be-84b4-5677154d8db8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:36.568112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 158/317] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:36 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:36.573903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:36.673518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a451f-7a2f-4523-a307-7bd39f7f6347 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:36.708019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:36.708679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:36.708962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:36.709241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:36.710087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] RBAC: Adding query filter params (role.id=248a233a9b5f4c9fa2bcce523d5f43fd, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10, user.id=cafa7513fff7463b9139f22da9791f06) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:36.710402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:36.711827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2b309-9223-43e9-9335-50432a376ff2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:36.718366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 160/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:37:36 2022] GET /identity/v3/role_assignments?user.id=cafa7513fff7463b9139f22da9791f06&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=248a233a9b5f4c9fa2bcce523d5f43fd => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:37.680345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0002051-a3a4-446e-88f7-dd906ed7448d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:37.680858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0002051-a3a4-446e-88f7-dd906ed7448d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:37.680932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0002051-a3a4-446e-88f7-dd906ed7448d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:37.682731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 159/319] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:37.688131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:37.688555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:37.688730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:37.706087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:37.707254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:37.772368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 161/320] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:37.795809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0002051-a3a4-446e-88f7-dd906ed7448d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:37.900817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0002051-a3a4-446e-88f7-dd906ed7448d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:37.940949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904bc84-426e-4fb0-acb9-cdb4b23427c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:37.941757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bc84-426e-4fb0-acb9-cdb4b23427c0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:37.942081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bc84-426e-4fb0-acb9-cdb4b23427c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:37.942355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bc84-426e-4fb0-acb9-cdb4b23427c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:37.943505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904bc84-426e-4fb0-acb9-cdb4b23427c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:37.944962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904bc84-426e-4fb0-acb9-cdb4b23427c0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:37.949894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 160/321] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:37.952978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.008839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24d37-4395-4a6d-9ea9-0a2baaa19ab4 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.009126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24d37-4395-4a6d-9ea9-0a2baaa19ab4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.009638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24d37-4395-4a6d-9ea9-0a2baaa19ab4 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.011568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 161/322] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:38.016267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.016554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.016827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.033818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:38.035029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:38.054925 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97bb7-200f-43d2-aa25-978abbbb5d31 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.088802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353aef7-78e4-4ad9-9c99-ebabd57284c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.089472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353aef7-78e4-4ad9-9c99-ebabd57284c2 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.089754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353aef7-78e4-4ad9-9c99-ebabd57284c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.090057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353aef7-78e4-4ad9-9c99-ebabd57284c2 None admin] PATH_INFO: `/v3/groups` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.090736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353aef7-78e4-4ad9-9c99-ebabd57284c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:38.092676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353aef7-78e4-4ad9-9c99-ebabd57284c2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:38.103845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 162/323] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:38.109930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 162/324] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Mar 8 14:37:37 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:38.127461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.221342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4f04-276b-4547-96af-55f3a5c5c286 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.221666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4f04-276b-4547-96af-55f3a5c5c286 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.221831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4f04-276b-4547-96af-55f3a5c5c286 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.223813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 163/325] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:38.229161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.229456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.229737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.230403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4a41-ada4-4edd-ada0-c9a5b816df98 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.248053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:38.249600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:38.328665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 164/326] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:38.351426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.392515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.393313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.393590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.393925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.407118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:38.415259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:38.416772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 163/327] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:38.423470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.469922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4be968-b154-4d4d-adf1-1da903408c2f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.510139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.510945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.511225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.511497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.522776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:38.530363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:38.531935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 165/328] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:38.538452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.540120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8600b9-e7fb-459f-9828-0f7b0efd8e8a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.576217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.577678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.579021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.579350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.580064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:38.580370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:38.581898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:38.591076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 164/329] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:38.597213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.647717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd730c3-a782-4644-8e61-967258f23876 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.700220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.700983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.701168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.701521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.702595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:38.702900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:38.704152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097d77a-01ea-475f-aec3-425fe174a8a9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.704534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:38.714736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 166/330] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:38.722861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.739002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.740235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.740721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.741197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] PATH_INFO: `/v3/users/da633761bafa4a568307ec009572e863` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.742681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] RBAC: Authorizing `identity:get_user(user_id=da633761bafa4a568307ec009572e863)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:38.744345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:38.746514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 165/331] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/users/da633761bafa4a568307ec009572e863 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:38.752431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.826364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1efd-b228-4dd0-907b-8afaadc56b3b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.855469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dbc5e-6e17-4249-86e2-741f623cee41 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:38.865112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.866020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.866296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.866567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] PATH_INFO: `/v3/users/af9e58a7d81f41a282b695066ebdb5de` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.868013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] RBAC: Authorizing `identity:get_user(user_id=af9e58a7d81f41a282b695066ebdb5de)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:38.869199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:38.870852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 167/332] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/users/af9e58a7d81f41a282b695066ebdb5de => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:38.876489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:38.892204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:38.893207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:38.893717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:38.894231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:38.895247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] RBAC: Adding query filter params (role.id=76557cef496747999b703b4bc4b6b5d7, user.id=da633761bafa4a568307ec009572e863, scope.system=all) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:38.895773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:38.897414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ef09a-d823-480d-bed4-9c8c9ea7206d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:38.910908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 166/333] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Mar 8 14:37:38 2022] GET /identity/v3/role_assignments?user.id=da633761bafa4a568307ec009572e863&scope.system=all&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:38.985226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7002d-0c9c-49bf-a325-1a42873fdb9e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:39.022338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb793181-429b-4f97-973d-9e2702c56ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:39.023223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793181-429b-4f97-973d-9e2702c56ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:39.023500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793181-429b-4f97-973d-9e2702c56ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:39.023785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793181-429b-4f97-973d-9e2702c56ca1 None admin] PATH_INFO: `/v3/system/users/af9e58a7d81f41a282b695066ebdb5de/roles/248a233a9b5f4c9fa2bcce523d5f43fd` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:39.025302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793181-429b-4f97-973d-9e2702c56ca1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af9e58a7d81f41a282b695066ebdb5de, role_id=248a233a9b5f4c9fa2bcce523d5f43fd)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:39.026718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793181-429b-4f97-973d-9e2702c56ca1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:39.039465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Mar 8 14:37:38 2022] PUT /identity/v3/system/users/af9e58a7d81f41a282b695066ebdb5de/roles/248a233a9b5f4c9fa2bcce523d5f43fd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:37:41.202320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1107ad-c0ed-4a3d-90cc-68722b528532 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.203448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1107ad-c0ed-4a3d-90cc-68722b528532 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.203448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1107ad-c0ed-4a3d-90cc-68722b528532 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.204777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 167/335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:41.210348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04df08-f23f-46b8-9da3-bc2462cc8aa3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.211221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04df08-f23f-46b8-9da3-bc2462cc8aa3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.211713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04df08-f23f-46b8-9da3-bc2462cc8aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.234878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7c04df08-f23f-46b8-9da3-bc2462cc8aa3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:41.236432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7c04df08-f23f-46b8-9da3-bc2462cc8aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:41.320457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 169/336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:41.334433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d92fe-3b6d-4051-9858-38f374fcf1f8 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.334715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d92fe-3b6d-4051-9858-38f374fcf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.334988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d92fe-3b6d-4051-9858-38f374fcf1f8 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.336867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 168/337] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:41.355382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.356001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.356106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d92fe-3b6d-4051-9858-38f374fcf1f8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:41.356598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.382882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:41.384517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:41.460927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d92fe-3b6d-4051-9858-38f374fcf1f8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:41.470210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 170/338] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:41.504608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:41.505418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.505694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.505989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.520559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:41.527740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:41.529248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 169/339] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:41.535180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:41.546799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:41.646394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fec71-750b-488d-a6a1-0affef8d53d6 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:41.650990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ec024-ddb0-4d23-8bdd-ba01bc8ffd67 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:41.680172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:41.680916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.681195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.681463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.692836 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:41.693315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:41.694269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.694753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.695228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.696172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:41.696696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:41.698298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:41.700336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:41.702044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 170/340] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:41.708345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:41.709274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 171/341] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:41.716132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:41.813054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3f7c-0816-42e1-abc7-546b015d59da None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:41.829621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5abee-2b97-4d09-b5f0-5b6dc31c6582 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:41.849008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:41.850122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.850612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.851075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.852019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:41.852518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:41.854160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:41.864010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 171/342] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:41.868422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:41.869378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:41.869665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:41.869986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:41.870851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:41.957496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:41.959064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:41.977075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089328-34be-492a-b98b-dccc0b4c2ed5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.012638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.013646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.014182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.014667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.072804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 172/343] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:42.080911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.101303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.102847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.282607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfb77-ad49-4ed3-bb7e-17c0d0a9d0ec None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.294715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 172/344] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:42.303595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.345715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.346921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.347343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.347793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.353169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.354910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.357153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 173/345] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:42.363176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.465587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4044b40-63a5-473b-9469-0ad841c9809e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.486056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b705661-345e-4aa7-afd0-2af45c1a32cf None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.532213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2038f2-ac89-4f37-a398-455b914fc4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.533385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2038f2-ac89-4f37-a398-455b914fc4fe None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.533831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2038f2-ac89-4f37-a398-455b914fc4fe None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.535289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2038f2-ac89-4f37-a398-455b914fc4fe None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.537221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2038f2-ac89-4f37-a398-455b914fc4fe None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.538859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2038f2-ac89-4f37-a398-455b914fc4fe None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.541332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 173/346] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:42.542878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d8b9-e7ab-44b1-80c7-d1af89017060 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.544393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d8b9-e7ab-44b1-80c7-d1af89017060 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.546182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d8b9-e7ab-44b1-80c7-d1af89017060 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.548706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 174/347] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:42.550628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d8b9-e7ab-44b1-80c7-d1af89017060 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.556064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa12ef-095c-46f7-acd6-c486e209b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.557156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa12ef-095c-46f7-acd6-c486e209b44b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.557587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa12ef-095c-46f7-acd6-c486e209b44b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.558073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa12ef-095c-46f7-acd6-c486e209b44b None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.571783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa12ef-095c-46f7-acd6-c486e209b44b None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.573256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa12ef-095c-46f7-acd6-c486e209b44b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.574964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 174/348] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:42.576160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.576482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.577010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.606969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:42.608221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:42.669797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d8b9-e7ab-44b1-80c7-d1af89017060 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.705426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.706558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.706979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.707468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.708124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 175/349] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:42.708907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.709020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.710669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.712468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 175/350] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:42.727189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.908150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3bc1-f959-45a9-93ef-56a4248d44cb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.908327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3badc-afb9-4df7-bc53-c94d2d5dced7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:42.949368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.949578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:42.950262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.950610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.950865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.950981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.952181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.952637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.953293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=cf399969d7b3447cb1c476a26351da2e) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:42.953681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.954023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=cf399969d7b3447cb1c476a26351da2e) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:42.954515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:42.955288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.956285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702eb55-1f40-458b-9e28-c84be919b0c4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:42.962028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 176/351] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=24213b919d7548379490f689a4ceb95d => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:42.962592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 176/352] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:42.962846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:42.970129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ab84-e334-41ec-aca8-de3f87205f5d None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.970129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ab84-e334-41ec-aca8-de3f87205f5d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.970129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ab84-e334-41ec-aca8-de3f87205f5d None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.970375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 177/353] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:42.971690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45fd6-ab27-44ae-acfd-20b1ca73d038 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.972057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45fd6-ab27-44ae-acfd-20b1ca73d038 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.972402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45fd6-ab27-44ae-acfd-20b1ca73d038 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:42.974390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 178/354] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:42.980852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278128c-f295-49b9-9d1e-2007eac75e6f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:42.981569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278128c-f295-49b9-9d1e-2007eac75e6f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:42.981878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278128c-f295-49b9-9d1e-2007eac75e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.007383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4278128c-f295-49b9-9d1e-2007eac75e6f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:43.010257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4278128c-f295-49b9-9d1e-2007eac75e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:43.126311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9052b-1454-4c20-8f42-69ec02d8b3e7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:43.164740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 179/355] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:43.166417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.166907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.167374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.175418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:43.176235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.176515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.176785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.192280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:43.198244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:43.199351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:43.199822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 177/356] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:43.201000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:43.206143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:43.344245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ffb78-008e-4460-8048-0bae6fb689ed None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:43.352184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 180/357] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:43.353128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:43.388892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:43.389572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.389984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.390264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.391021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:43.391328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:43.392711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:43.401675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 178/358] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:43.413163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:43.528107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4b148-61f1-49a9-a81a-7265c5352170 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:43.561511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cf4a9-1db9-4ca2-85cd-87522067c553 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:43.572332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:43.572988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.573262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.573530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.617736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:43.618957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.619463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.619933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.639511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:43.653873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:43.656548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 181/359] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:43.657574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:43.666200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:43.667684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:43.780506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 179/360] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:43.781299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:43.836179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dcbf4-0790-41f8-bf24-671aca9116cb None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:43.872833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:43.874218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.874498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.874768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.885169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:43.893114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 14:37:43.894360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 182/361] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:43.895210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:43.915728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0a6-8304-4493-9a5f-7b4e99d6a22b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:43.962552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:43.963227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.963678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.963953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.965321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:43.965644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:43.967893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc069e-371d-44fc-b7b2-739f90dcbe3b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:43.978712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 180/362] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:43.980250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9843b86-3e09-46e6-91b7-d0f8a8055955 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:43.980700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9843b86-3e09-46e6-91b7-d0f8a8055955 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:43.981684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9843b86-3e09-46e6-91b7-d0f8a8055955 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:43.983922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 181/363] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:43.985092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9843b86-3e09-46e6-91b7-d0f8a8055955 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.007386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930d7d-8129-49c3-8896-8411dd145d31 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.048806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.049946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.050373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.050792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.052156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.053771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.055936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 183/364] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.056863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.107133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9843b86-3e09-46e6-91b7-d0f8a8055955 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.163240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.163909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.164353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.164837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.165778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:44.166334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.167936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4855b-d7c5-4824-b880-7eea2969b1ba None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.181035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12600-0710-4c3c-bb67-e585e35a7174 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.181541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 182/365] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.183134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.183640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.184134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.204093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:44.205595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:44.222300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.222959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.223244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.223520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.287423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 183/366] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:44.294046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.323926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.325369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.424326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869696-2fae-4d60-a583-06e017d2e8c1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.461973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.462914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.463197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.463448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 184/367] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:44.463870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.464917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.466429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.467968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.470556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 184/368] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.470556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.582078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec94549-66a3-4d24-8d10-91b14ddaa201 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.593739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e6b84-3179-4e4d-92e4-227b222ac49d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.618702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.619639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.619927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.620200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] PATH_INFO: `/v3/users/af9e58a7d81f41a282b695066ebdb5de` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.621406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] RBAC: Authorizing `identity:get_user(user_id=af9e58a7d81f41a282b695066ebdb5de)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.622928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.624813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 185/369] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/users/af9e58a7d81f41a282b695066ebdb5de => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.625583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.636527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.637643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.638182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.638667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.650023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:44.658569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:44.660022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 185/370] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:44.660990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.731892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c8103-c4a9-476a-afc0-5d42bfc5125a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.766699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd4181-cdfd-484d-a03f-5681c25a62f8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.767740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.768738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.768936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.769201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.770734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.771872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.773556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 186/371] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.775263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.803281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.804297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.804775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.805242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.806312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:44.806833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.808460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.815226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 186/372] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.816271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.888555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7fa5d-e7f2-40fe-8961-36fd32fdcd86 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.926097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82164b7-b82b-45bf-87ce-0b60024cb816 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:44.927862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.928537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.928824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.929099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.930135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] RBAC: Adding query filter params (role.id=248a233a9b5f4c9fa2bcce523d5f43fd, user.id=af9e58a7d81f41a282b695066ebdb5de, scope.system=all) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:44.930245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.931687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:44.945098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 187/373] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/role_assignments?user.id=af9e58a7d81f41a282b695066ebdb5de&scope.system=all&role.id=248a233a9b5f4c9fa2bcce523d5f43fd => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:44.949889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:44.986748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:44.987834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:44.988323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:44.988823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:44.989786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:44.990361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:44.991960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.006079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 187/374] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:45.011872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:45.076103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d82200-eba5-464a-8649-d15c7ab9917f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:45.119597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:45.120775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:45.121239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:45.121722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:45.124765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:45.126529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.128858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 188/375] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:44 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:45.134636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:45.148550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bed43c-1e49-40d6-b210-ec24f18918a0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:45.187000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:45.188104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:45.188593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:45.189177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:45.260664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5161-000e-4a74-97cc-d61513b00da9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:45.286822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:45.288878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.319241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:45.319919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:45.320205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:45.320478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:45.321311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:45.321623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:45.323090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.340389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 189/376] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:45 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=24213b919d7548379490f689a4ceb95d => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:45.409802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 188/377] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:45.415982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:45.522229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62bd7-461e-4542-8add-86dbcc537055 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:45.564136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:45.565010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:45.565294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:45.565568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] PATH_INFO: `/v3/projects/419bd55459f54e4a803dd03c0fde0573` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:45.566796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] RBAC: Authorizing `identity:get_project(project_id=419bd55459f54e4a803dd03c0fde0573)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:45.568257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.570054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 190/378] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:45 2022] GET /identity/v3/projects/419bd55459f54e4a803dd03c0fde0573 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:45.575669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:45.694314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc9f8c-b3cc-48f0-aad4-2da6ff5b2d36 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:45.733359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c86ff-0d3b-4b72-a3ee-45c9daa25177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:45.734251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c86ff-0d3b-4b72-a3ee-45c9daa25177 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:45.734538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c86ff-0d3b-4b72-a3ee-45c9daa25177 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:45.734815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c86ff-0d3b-4b72-a3ee-45c9daa25177 None admin] PATH_INFO: `/v3/groups/4e32a8368ed143fdb3daf4f9a0dab6f5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:45.740763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c86ff-0d3b-4b72-a3ee-45c9daa25177 None admin] RBAC: Authorizing `identity:get_group(group_id=4e32a8368ed143fdb3daf4f9a0dab6f5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:45.742252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c86ff-0d3b-4b72-a3ee-45c9daa25177 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.744181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 189/379] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:45 2022] GET /identity/v3/groups/4e32a8368ed143fdb3daf4f9a0dab6f5 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:45.750670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:45.895979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fde99-a556-4092-896d-ffdb4ff220a8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:45.933763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:45.934740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:45.935169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:45.935633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:45.936992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] RBAC: Adding query filter params (group.id=4e32a8368ed143fdb3daf4f9a0dab6f5, role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=419bd55459f54e4a803dd03c0fde0573) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:45.937452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:45.939403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41015d-d4eb-4ffe-9ff3-3f7401491697 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:45.945260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 191/380] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:45 2022] GET /identity/v3/role_assignments?group.id=4e32a8368ed143fdb3daf4f9a0dab6f5&scope.project.id=419bd55459f54e4a803dd03c0fde0573&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:46.175543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d3a96-64f1-4e53-b394-304ba5094231 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.176284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d3a96-64f1-4e53-b394-304ba5094231 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.176561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d3a96-64f1-4e53-b394-304ba5094231 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.177578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d7a27-d0b6-4b95-8030-0a8b656e5521 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.178114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d7a27-d0b6-4b95-8030-0a8b656e5521 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.178583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d7a27-d0b6-4b95-8030-0a8b656e5521 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.178882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 190/381] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:46.180753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 192/382] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:46.186433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.186679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.186804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.187041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.187483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.187995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.206874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:46.208376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:46.209871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:46.211817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:46.299444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 193/383] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:46.308611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 191/384] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:46.323250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:46.353738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:46.490243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1c77c-a3bb-4f3b-9f3f-5bc330cf6de5 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:46.520691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e75567-ac1f-4d4b-859d-3ecaca4165cd None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:46.546375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:46.547546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.548194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.549411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.569937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:46.582788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:46.588179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:46.589591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.590110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.590612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.591730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 192/385] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:46.595996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:46.617968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:46.627657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:46.631873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 194/386] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:46.639511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:46.792242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928ab3f-33ff-4582-82e7-8d96c16c8bef None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:46.827149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ec5ad-6c19-4c8f-b214-3bf086e2c884 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:46.885983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:46.887871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.888162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.888442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.889769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:46.890136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:46.891532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:46.895930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:46.896637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:46.896919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:46.897191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:46.897986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] RBAC: Adding query filter params (name=member) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:46.898330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:46.899667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:46.912461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 195/387] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:46.914347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 193/388] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:46.919855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:46.920303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:47.099883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36509e-60f6-4349-94ba-659c5fd1e88e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:47.114772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144a70-1c29-48c8-981b-c5bcd1e720be None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:47.158566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:47.159444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:47.159726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:47.159998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:47.161687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:47.163185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:47.165159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 194/389] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:46 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:47.171902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:47.187851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:47.187851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:47.187851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:47.187851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:47.189541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:47.192044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:47.194269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 196/390] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:46 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:47.201538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:47.300989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0953b-76b0-412d-890d-5aa651cb3dcb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:47.363552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:47.364405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:47.364691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:47.364967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:47.370903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:47.372352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:47.375072 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 195/391] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:47 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:47.378762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb3cf3-541a-44a5-a089-3fa70e53b73b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:47.381087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:47.430382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:47.431260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:47.431541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:47.431816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:47.433031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:47.435388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:47.438329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 197/392] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:47 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:47.443827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:47.537556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733401-93b4-4e79-aa6c-b2a108a14d22 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:47.583639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7ff76-281a-41f8-b326-424de088e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:47.584801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7ff76-281a-41f8-b326-424de088e64a None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:47.585178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7ff76-281a-41f8-b326-424de088e64a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:47.585547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7ff76-281a-41f8-b326-424de088e64a None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:47.590886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7ff76-281a-41f8-b326-424de088e64a None admin] RBAC: Authorizing `identity:create_grant(project_id=cf399969d7b3447cb1c476a26351da2e, group_id=08b0a1bc7eba4868857c8b80f3862baa, role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:47.593391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7ff76-281a-41f8-b326-424de088e64a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:47.619225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 196/393] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Mar 8 14:37:47 2022] PUT /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/24213b919d7548379490f689a4ceb95d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:47.631777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd5efe-d561-4e19-80c6-ccd65ed1a008 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:47.686792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c9680-e8ef-4955-b576-5d40381385fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:47.687721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c9680-e8ef-4955-b576-5d40381385fb None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:47.688005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c9680-e8ef-4955-b576-5d40381385fb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:47.688285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c9680-e8ef-4955-b576-5d40381385fb None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:47.694889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c9680-e8ef-4955-b576-5d40381385fb None admin] RBAC: Authorizing `identity:create_grant(project_id=cf399969d7b3447cb1c476a26351da2e, group_id=08b0a1bc7eba4868857c8b80f3862baa, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:47.696407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c9680-e8ef-4955-b576-5d40381385fb None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:47.711852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 198/394] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Mar 8 14:37:47 2022] PUT /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:37:48.238209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8a90a-7d2f-4c47-a6e1-45aeb4c9324c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.238571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8a90a-7d2f-4c47-a6e1-45aeb4c9324c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.238768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8a90a-7d2f-4c47-a6e1-45aeb4c9324c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.240790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 197/395] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:48.246073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.246364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.246654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.264340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:48.265533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:48.334455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 199/396] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:48.358255 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8a90a-7d2f-4c47-a6e1-45aeb4c9324c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:48.487131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8a90a-7d2f-4c47-a6e1-45aeb4c9324c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:48.525376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d6725-21f9-4edb-8cb4-b9b14223cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:48.526122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6725-21f9-4edb-8cb4-b9b14223cae4 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.526401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6725-21f9-4edb-8cb4-b9b14223cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.526673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6725-21f9-4edb-8cb4-b9b14223cae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.543911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d6725-21f9-4edb-8cb4-b9b14223cae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:48.551800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-431d6725-21f9-4edb-8cb4-b9b14223cae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:48.553005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 198/397] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:48.558933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:48.597062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac76e7a-85aa-4ce3-ba17-598ff45ca201 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.597558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac76e7a-85aa-4ce3-ba17-598ff45ca201 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.597632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac76e7a-85aa-4ce3-ba17-598ff45ca201 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.599634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 199/398] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:48.604759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.605038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.605302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.632197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:48.633378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:48.681674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9db5dd-545d-45cf-aa3d-16f0055321c7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:48.719534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:48.720218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.720591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.720882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.721630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:48.721966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:48.723344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:48.728482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 200/399] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:48.737469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 200/400] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:48.738609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:48.764711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:48.842226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a2a0b-8a33-4cba-9759-527121753f07 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:48.877396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:48.878292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.878567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.878843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.880017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:48.887934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:48.887934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 201/401] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:48 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:48.889356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:48.899152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ba1e-cb76-4bdd-9364-1b5c31c1a940 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:48.943623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:48.944737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:48.945221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:48.945748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:48.965411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:48.981976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:48.984318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 201/402] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:48.990463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.014279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb989df-9676-4fe6-a1e7-bf61778d63ad None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.050112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.050982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.051255 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.051523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.052724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.057089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.057089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 202/403] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:48 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:49.062673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.159202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d6ce-d96a-4354-b450-da7defda6896 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.199758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.200434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.200716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.200992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.206669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:49.206991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.208552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.220172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 202/404] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:49.225803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.272779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70209a0c-3315-4daa-b4e3-5af729bf37ca None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.334720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.335635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.335918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.336195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.337399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5a287-0445-4ba1-853a-01d92f7ccf7d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.338268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10, group_id=08b0a1bc7eba4868857c8b80f3862baa, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.339744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.364447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 203/405] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Mar 8 14:37:49 2022] PUT /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:49.376336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d3a74-d1d6-4805-9bef-e81ccf32c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.377272 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d3a74-d1d6-4805-9bef-e81ccf32c40b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.377549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d3a74-d1d6-4805-9bef-e81ccf32c40b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.377818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d3a74-d1d6-4805-9bef-e81ccf32c40b None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.379064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d3a74-d1d6-4805-9bef-e81ccf32c40b None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.380586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d3a74-d1d6-4805-9bef-e81ccf32c40b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.382830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 203/406] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:49 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:49.388347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.467224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b307-c6ed-44c7-8053-84a1eb979249 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.467536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b307-c6ed-44c7-8053-84a1eb979249 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.467746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b307-c6ed-44c7-8053-84a1eb979249 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.469587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 204/407] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:49.484196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.484514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.484736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.508755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:49.510707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:49.548036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118caf6e-4d1b-4eb4-8739-56de467e05a6 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.584576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 205/408] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:49.609486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.612594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.613482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.613762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.614058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.618670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.620173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.622324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 204/409] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:49 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:49.641828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.721606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc5f3-dc7d-4fb8-8d27-a8853e3ded7b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.767815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.768617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.768896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.769165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.781719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:49.791219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:49.793118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 206/410] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:49.799224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:49.800870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e977553-85b0-4c9b-bd18-6cecf6e4b4ed None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.846945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.847843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.848126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.848402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.851846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10, group_id=08b0a1bc7eba4868857c8b80f3862baa, role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.854010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.876042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 205/411] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Mar 8 14:37:49 2022] PUT /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10/groups/08b0a1bc7eba4868857c8b80f3862baa/roles/24213b919d7548379490f689a4ceb95d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:37:49.927567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e73c7-59ee-4260-a9f9-edae37ffc403 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:49.966924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:49.967926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:49.968214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:49.968487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:49.969239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:49.969541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:49.970987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:49.980507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 207/412] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:49.986339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:50.099052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ae1e5-b4af-4819-8a49-db27c8b9fca5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:50.144467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:50.145352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.145629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.145924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] PATH_INFO: `/v3/groups/4e32a8368ed143fdb3daf4f9a0dab6f5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.147121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] RBAC: Authorizing `identity:get_group(group_id=4e32a8368ed143fdb3daf4f9a0dab6f5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:50.148585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:50.150554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 206/413] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:49 2022] GET /identity/v3/groups/4e32a8368ed143fdb3daf4f9a0dab6f5 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:50.156833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:50.273885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed24a1-099c-45c5-8d6e-bb7f093aaca6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:50.311122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad6fe-530c-49da-81c6-781c1148e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:50.312067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad6fe-530c-49da-81c6-781c1148e993 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.312347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad6fe-530c-49da-81c6-781c1148e993 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.312643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad6fe-530c-49da-81c6-781c1148e993 None admin] PATH_INFO: `/v3/projects/419bd55459f54e4a803dd03c0fde0573` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.313810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad6fe-530c-49da-81c6-781c1148e993 None admin] RBAC: Authorizing `identity:get_project(project_id=419bd55459f54e4a803dd03c0fde0573)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:50.315479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad6fe-530c-49da-81c6-781c1148e993 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:50.317489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 208/414] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:50 2022] GET /identity/v3/projects/419bd55459f54e4a803dd03c0fde0573 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:50.323093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:50.440681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea85781-cdb4-4858-845f-b62288017c73 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:50.479322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0d024-970e-4d06-959b-a657e3c802cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:50.480240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0d024-970e-4d06-959b-a657e3c802cf None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.480514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0d024-970e-4d06-959b-a657e3c802cf None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.480780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0d024-970e-4d06-959b-a657e3c802cf None admin] PATH_INFO: `/v3/projects/419bd55459f54e4a803dd03c0fde0573/groups/4e32a8368ed143fdb3daf4f9a0dab6f5/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.483866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0d024-970e-4d06-959b-a657e3c802cf None admin] RBAC: Authorizing `identity:create_grant(project_id=419bd55459f54e4a803dd03c0fde0573, group_id=4e32a8368ed143fdb3daf4f9a0dab6f5, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:50.485505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0d024-970e-4d06-959b-a657e3c802cf None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:50.518379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 207/415] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Mar 8 14:37:50 2022] PUT /identity/v3/projects/419bd55459f54e4a803dd03c0fde0573/groups/4e32a8368ed143fdb3daf4f9a0dab6f5/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:37:50.788469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa9a8-f4ff-4618-8ae4-3fd74c25a075 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.789530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa9a8-f4ff-4618-8ae4-3fd74c25a075 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.790058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa9a8-f4ff-4618-8ae4-3fd74c25a075 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.792285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 209/416] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:50.798726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.799569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.800068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.820656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:50.822251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:50.902715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e781-9346-449c-a0cb-95f77903b3cf None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.903038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e781-9346-449c-a0cb-95f77903b3cf None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.903283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e781-9346-449c-a0cb-95f77903b3cf None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.906898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 210/417] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:50.911357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bdb91-acae-4d08-8210-a582631399cb None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:50.911646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bdb91-acae-4d08-8210-a582631399cb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:50.911924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bdb91-acae-4d08-8210-a582631399cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:50.927005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 208/418] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:50.932150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-601bdb91-acae-4d08-8210-a582631399cb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:50.933365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-601bdb91-acae-4d08-8210-a582631399cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:50.975336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:51.006825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 211/419] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:51.033759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bdb91-acae-4d08-8210-a582631399cb None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:51.145789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bdb91-acae-4d08-8210-a582631399cb None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:51.182688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:51.183503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:51.184086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:51.184372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:51.195629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:51.204592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:51.206196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 212/420] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:51.213689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:51.228622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4c648-a510-40dc-9e5b-3fa0b14c1803 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:51.319165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:51.320350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:51.320832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:51.321302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:51.322296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fe06-bb1d-43a0-8f41-1de0b143655e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:51.350714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:51.359595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:51.361319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 209/421] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:51.367207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:51.367491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:51.368329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:51.368752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:51.369167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:51.370275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:51.371616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:51.373363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:51.384474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 213/422] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:51.390963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:51.517556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3600-a6a6-4aec-8c1b-d2435a72f416 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:51.553383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:51.554485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:51.554976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:51.555454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:51.556525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:51.557082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:51.558841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:51.569183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 210/423] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:51.573908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630002ef-cf4c-474d-a581-6890ae5cbc2d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:51.575096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:51.629222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:51.630131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:51.630554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:51.630980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:51.678219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265bf2d-1a65-4b74-902a-0432f6ce4ece None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:51.715923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:51.717017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:51.718351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:51.719400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:51.775007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:51.776403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:51.801349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:51.803579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:51.905505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 211/424] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:51.911264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.018650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 214/425] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:37:52.023910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.024531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158cef7-ed71-4252-9424-518ea02ac799 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.069513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.071428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.072553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.073033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.075677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:52.078326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:52.080833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 212/426] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:51 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:52.101745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.209199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db08921-96e1-4b89-a981-4158df18232a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.243039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a6156-f8b3-47af-8d97-b7f2c0e1be61 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.245491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0d414-404a-4f6e-ae2b-bb565ed0e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.246654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0d414-404a-4f6e-ae2b-bb565ed0e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.247141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0d414-404a-4f6e-ae2b-bb565ed0e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.247618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0d414-404a-4f6e-ae2b-bb565ed0e4e6 None admin] PATH_INFO: `/v3/projects/cf399969d7b3447cb1c476a26351da2e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.249208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0d414-404a-4f6e-ae2b-bb565ed0e4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=cf399969d7b3447cb1c476a26351da2e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:52.250914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0d414-404a-4f6e-ae2b-bb565ed0e4e6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:52.253114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 215/427] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/projects/cf399969d7b3447cb1c476a26351da2e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:52.254536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b23f3-0157-4e6c-abbd-8965033efd2b None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.255029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b23f3-0157-4e6c-abbd-8965033efd2b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.255506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b23f3-0157-4e6c-abbd-8965033efd2b None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.257609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 216/428] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:52.258530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b23f3-0157-4e6c-abbd-8965033efd2b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.281218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620fad4-7ea0-48ac-832f-48a871404146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.282480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620fad4-7ea0-48ac-832f-48a871404146 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.282480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620fad4-7ea0-48ac-832f-48a871404146 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.282677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620fad4-7ea0-48ac-832f-48a871404146 None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.283806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620fad4-7ea0-48ac-832f-48a871404146 None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:52.285249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620fad4-7ea0-48ac-832f-48a871404146 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:52.287205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 213/429] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:52.292063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.292063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.292063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.307342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:52.308521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:52.370933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b23f3-0157-4e6c-abbd-8965033efd2b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.381960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 214/430] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:52.382863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.407253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.408631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.409122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.409624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.411035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:52.412677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:52.414858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 217/431] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:52.421388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.511081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40063d-6c13-4f22-98dd-d50f81817edd None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.545697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dec61f-79f9-4a9e-b6f1-60903b0ceb63 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.555051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.556344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.556833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.557620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.558938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=cf399969d7b3447cb1c476a26351da2e) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:52.559624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:52.562454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:52.575254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 215/432] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=24213b919d7548379490f689a4ceb95d => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:52.575254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.597674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.598417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.598705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.598981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.599827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=cf399969d7b3447cb1c476a26351da2e) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:52.600141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:52.601623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:52.612066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 218/433] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=cf399969d7b3447cb1c476a26351da2e&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:52.722342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e9d5b-4bc1-40a7-9893-57431e9faad5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:52.777140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe55d2-6f8a-47e9-9e5d-9a2423e3ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:52.778052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe55d2-6f8a-47e9-9e5d-9a2423e3ec25 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.778332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe55d2-6f8a-47e9-9e5d-9a2423e3ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.778603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe55d2-6f8a-47e9-9e5d-9a2423e3ec25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.795945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe55d2-6f8a-47e9-9e5d-9a2423e3ec25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:52.804780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3ebe55d2-6f8a-47e9-9e5d-9a2423e3ec25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 14:37:52.805359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 216/434] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:52.811932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:52.903851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089ddfb-763c-4ab8-92f8-69e20ba0297f None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.904587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089ddfb-763c-4ab8-92f8-69e20ba0297f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.904876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089ddfb-763c-4ab8-92f8-69e20ba0297f None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.906971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 217/435] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:52.916948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:52.917279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:52.917512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:52.941021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:52.941743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:52.953543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8203ae8-344c-49e1-856b-869e07706fc3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.000463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.001134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.001418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.001698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.002481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:53.002787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.004202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.014154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 219/436] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:37:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:53.020742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.050069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 218/437] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:53.070445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.160403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01af35-8bd4-4afb-ba45-03c0cc20f3c8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.197498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8d1c-c38a-471e-8285-87fa1201d61b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.198678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.199335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.199646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.199925 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.236279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.237449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.237969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.238340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.250771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:53.258964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:53.260336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 219/438] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:53.267286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.285097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.286980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.402758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99e12-e1f1-45f6-9ede-f3b492204437 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.408237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 220/439] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:53.413841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.450934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.452229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.452582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.452944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.453761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:53.454109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.455500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d667a-dd10-4bd1-8b94-bd38a462bb43 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.463708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 220/440] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:53.465050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7acc1-7703-43b6-bc3c-942280cd1213 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.465336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7acc1-7703-43b6-bc3c-942280cd1213 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.465611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7acc1-7703-43b6-bc3c-942280cd1213 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.467484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 221/441] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:53.471904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7acc1-7703-43b6-bc3c-942280cd1213 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.521424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee064-7bfe-4fe8-840c-0e26c802522b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.554079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81ec6-8e41-480c-b1a8-d7ba46a2f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.554939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81ec6-8e41-480c-b1a8-d7ba46a2f2cc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.555223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81ec6-8e41-480c-b1a8-d7ba46a2f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.555502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81ec6-8e41-480c-b1a8-d7ba46a2f2cc None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.556678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81ec6-8e41-480c-b1a8-d7ba46a2f2cc None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.558252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81ec6-8e41-480c-b1a8-d7ba46a2f2cc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.560151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 221/442] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:53.562253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.562543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.562824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.567990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7acc1-7703-43b6-bc3c-942280cd1213 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.579131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:53.580319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:53.599804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.600448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.600727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.601000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.643409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 222/443] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:53.644238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.664586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.666080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.739673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8891e8-6456-4293-bad4-cbc7f02a9bae None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.758492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 222/444] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:53.759310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.772012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.772813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.773096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.773373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.774555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.775980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.777571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 223/445] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:53.778340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.852534 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f46ce6-8d82-42c1-a214-eb651e4bd421 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.870824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b5e9-ce62-4302-8555-18299fb46f94 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:53.884464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.885252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.885528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.885798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.895383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:53.901605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:53.902485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:53.902649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:37:53.902764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:53.903037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] PATH_INFO: `/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:53.903837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 223/446] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:53.904713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] RBAC: Authorizing `identity:get_project(project_id=2a58ce40d9c847aa8cc3a0be7d01fc10)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:53.905124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:53.906277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:53.908063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 224/447] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/projects/2a58ce40d9c847aa8cc3a0be7d01fc10 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:53.910356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.004321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1439b3-4dad-45e7-920a-7ee4c4251f2e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.008030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48cfe3-3c6f-4cdf-9b22-16db2ae15464 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.036371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.036951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.037230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.037503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.038342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=76557cef496747999b703b4bc4b6b5d7, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:54.038650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.040081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.040786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.041444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.041912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.042191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.042929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:54.043229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.044585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.046022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 224/448] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=76557cef496747999b703b4bc4b6b5d7 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:54.046796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.052903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 225/449] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:54.058425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.155592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da91941-5d57-45b7-8a31-6974b756d847 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.163517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7e7c9-108b-4385-ab45-9e4a8604ca13 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.196193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.197065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.197345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.197617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] PATH_INFO: `/v3/groups/08b0a1bc7eba4868857c8b80f3862baa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.198844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] RBAC: Authorizing `identity:get_group(group_id=08b0a1bc7eba4868857c8b80f3862baa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.199060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.199707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.199986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.200258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.200363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.207427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 225/450] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:54 2022] GET /identity/v3/groups/08b0a1bc7eba4868857c8b80f3862baa => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:54.208366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.275306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.276763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.326276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c0323-03a5-44a8-9aa6-1aa8604c1a3a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.359662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.360317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.360598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.360861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.361675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] RBAC: Adding query filter params (group.id=08b0a1bc7eba4868857c8b80f3862baa, role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:54.362012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.363447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.369303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 226/451] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:54 2022] GET /identity/v3/role_assignments?group.id=08b0a1bc7eba4868857c8b80f3862baa&scope.project.id=2a58ce40d9c847aa8cc3a0be7d01fc10&role.id=24213b919d7548379490f689a4ceb95d => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:37:54.396209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 226/452] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:37:54.402315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.507231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f8686-6196-48de-a385-5725c1ca26a3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.540620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.541484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.541760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.542057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] PATH_INFO: `/v3/projects/419bd55459f54e4a803dd03c0fde0573` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.543229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] RBAC: Authorizing `identity:get_project(project_id=419bd55459f54e4a803dd03c0fde0573)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.545268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.547025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 227/453] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:37:54 2022] GET /identity/v3/projects/419bd55459f54e4a803dd03c0fde0573 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:54.552514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.650818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b9d8e-b7d0-46f1-9547-37d43a2f424b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.685187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77275501-5230-4e81-b80e-977fa9e4cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.686233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77275501-5230-4e81-b80e-977fa9e4cc9e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.686517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77275501-5230-4e81-b80e-977fa9e4cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.686793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77275501-5230-4e81-b80e-977fa9e4cc9e None admin] PATH_INFO: `/v3/groups/4e32a8368ed143fdb3daf4f9a0dab6f5` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.687974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77275501-5230-4e81-b80e-977fa9e4cc9e None admin] RBAC: Authorizing `identity:get_group(group_id=4e32a8368ed143fdb3daf4f9a0dab6f5)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.689413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77275501-5230-4e81-b80e-977fa9e4cc9e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.691142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 227/454] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Mar 8 14:37:54 2022] GET /identity/v3/groups/4e32a8368ed143fdb3daf4f9a0dab6f5 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:54.697084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:54.794365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096f05-ce00-4924-b816-8f91143413cd None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:54.824319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:54.824955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:54.825229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:54.825495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:54.827246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] RBAC: Adding query filter params (group.id=4e32a8368ed143fdb3daf4f9a0dab6f5, role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=419bd55459f54e4a803dd03c0fde0573) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:54.827557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:54.828983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482e2d-8125-448c-8d5b-93a2e712cd36 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:54.834375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 228/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Mar 8 14:37:54 2022] GET /identity/v3/role_assignments?group.id=4e32a8368ed143fdb3daf4f9a0dab6f5&scope.project.id=419bd55459f54e4a803dd03c0fde0573&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:57.841791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b45c5-a5aa-4045-8a24-a04cc7675c04 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:57.842894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b45c5-a5aa-4045-8a24-a04cc7675c04 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:57.843428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b45c5-a5aa-4045-8a24-a04cc7675c04 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:57.845691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 228/456] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:57.850983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d662-9304-489a-b2a1-d1c34b119aad None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:57.851810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d662-9304-489a-b2a1-d1c34b119aad None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:57.852293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d662-9304-489a-b2a1-d1c34b119aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:57.870421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6270d662-9304-489a-b2a1-d1c34b119aad None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:57.871950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6270d662-9304-489a-b2a1-d1c34b119aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:57.916657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670fd6-ea08-4443-8e0d-68046911f049 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:57.916968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670fd6-ea08-4443-8e0d-68046911f049 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:57.917225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61670fd6-ea08-4443-8e0d-68046911f049 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:57.919308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 229/457] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:57.925701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:57.926070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:57.926292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:57.957940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 229/458] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:57.959286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e456b0-d3e1-496f-8d00-0aae8803630a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:57.959570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e456b0-d3e1-496f-8d00-0aae8803630a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:57.959845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e456b0-d3e1-496f-8d00-0aae8803630a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:57.961244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:57.962682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:57.970322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 230/459] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:57.982991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:57.983308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:57.983572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.007796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:58.009022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:58.047718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 230/460] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:58.048671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.077727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 231/461] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:37:58.088588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.176403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a84bc3-c764-4e55-86d8-2265df2a9199 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.206787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4e9e-f83b-4535-9899-ad29624fc4a6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.218754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.219824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.220101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.220372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.234047 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.236266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.248123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.248949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.249224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.249493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.255055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:37:58.259891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.261170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 231/462] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:58.261372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.262044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.283931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:37:58.285453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 232/463] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:58.286270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.370402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7b3ae-ff86-4bb6-930a-87c4060dbaba None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.401266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04168e85-d61f-4b12-947d-d59b41ef36f6 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.404762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.405563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.405847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.406160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.416929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.418427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.435266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.435424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:37:58.435954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.436235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.436506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.436621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 232/464] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:58.437229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:58.437350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.437533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.438955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ad7f7-aa63-43ac-953d-292e02c2da28 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.452937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 233/465] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:58.454273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6bc7-a7e2-4eac-b5bc-a5182e32350d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.454558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6bc7-a7e2-4eac-b5bc-a5182e32350d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.454832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6bc7-a7e2-4eac-b5bc-a5182e32350d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.460611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 234/466] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:37:58.460611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6bc7-a7e2-4eac-b5bc-a5182e32350d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.546112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5c9c0-f424-4495-b596-4404a61416ff None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.557709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6bc7-a7e2-4eac-b5bc-a5182e32350d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.580880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.581594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.581824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.582136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.582854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:58.583170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.584552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.590926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.592179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.592454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.592723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.593425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:58.593723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.595119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041676aa-088e-407e-aeb2-7de5d71c8c9b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.597356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 233/467] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:58.598005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.616112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 235/468] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:58.616112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.616112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.616112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.629317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:58.630512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:58.701972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 236/469] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:58.701972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.712595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0631-4caa-44d7-8ab9-461b5dfb60c4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.750151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.750824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.751268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.751579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.752285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.753722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.785907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 234/470] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:58 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:58.785907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.807082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ae1f-2fb7-4f11-ab4f-ac96e8f81d32 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.846285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:58.847103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:58.847521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:58.847853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:58.848740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:58.850429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:58.872280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 237/471] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:58 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:58.873350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:58.946647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425242-ea4d-49c6-87ad-dcdf8cd1be3b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.991445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0b831-2e34-4fa6-b1e2-c65c621a391d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:58.999938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.000641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.000928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.001209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.002147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:59.003601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:59.049013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 235/472] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:58 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:37:59.055355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.056644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.057136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.057626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.072001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:59.073986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:59.094989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3281541c-c762-4fa7-a14b-b2dc8a9d5ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:37:59.097042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 238/473] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:59.103065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:59.212291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437327-5165-4596-8aa5-f3a3cd3f20fd None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.212948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437327-5165-4596-8aa5-f3a3cd3f20fd None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.213454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437327-5165-4596-8aa5-f3a3cd3f20fd None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.215517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 239/474] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:37:59.222863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.223483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.223979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.229167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db303e-3f3e-43b5-81b1-efb13f07d3a4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:59.245881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:37:59.247423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:37:59.268107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.268485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.268766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.269041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.269830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:59.270110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:59.271501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:59.285895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 236/475] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:37:59.291589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:59.330284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 240/476] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:37:59.353675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:59.403323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726de3ac-c56a-449a-a70c-a4b9268dd8dd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:59.438399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.439069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.439350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.439624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.440323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:59.441770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:59.459523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d22f5-19ab-472d-a320-0567206c6f9c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:59.474322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 237/477] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:37:59 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:37:59.503817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.504832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.505332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.505804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.506791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:59.508407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:59.517258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.sql.core [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 08 14:37:59.517258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 08 14:37:59.517258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [parameters: {'id': '67aacdc1c8a64f3dba96049b94a6d38d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 08 14:37:59.517258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 14:37:59.534494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 08 14:37:59.536757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 241/478] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Mar 8 14:37:59 2022] POST /identity/v3/roles => generated 144 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:37:59.546275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:59.655196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260c81d-934e-469b-8584-57a9179ad2b6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:59.691978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07062f6-8444-4c12-9198-4f3187df5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.692802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07062f6-8444-4c12-9198-4f3187df5d94 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.693078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07062f6-8444-4c12-9198-4f3187df5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.693348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07062f6-8444-4c12-9198-4f3187df5d94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.704492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07062f6-8444-4c12-9198-4f3187df5d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:37:59.711949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-d07062f6-8444-4c12-9198-4f3187df5d94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 14:37:59.713426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 238/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:37:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:37:59.718977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:37:59.831078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e66ee-ea29-4927-abb1-ca8d5732f195 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:37:59.865198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:37:59.866323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:37:59.866809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:37:59.867302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:37:59.868244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:37:59.868824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:37:59.870457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435cd2-c61f-4052-8522-4195294d4b8b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:37:59.880067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 242/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:37:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:01.587089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674466c-f901-413e-b12b-4e264e993ebb None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:01.588103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674466c-f901-413e-b12b-4e264e993ebb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:01.588743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674466c-f901-413e-b12b-4e264e993ebb None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:01.591019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 239/481] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:01.597074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:01.597951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:01.598452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:01.622939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:01.624526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:01.634823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf114c5-406e-4941-bbec-4a3f199a3a30 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:01.635112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf114c5-406e-4941-bbec-4a3f199a3a30 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:01.635400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf114c5-406e-4941-bbec-4a3f199a3a30 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:01.641879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 240/482] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:01.643296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:01.643580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:01.643853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:01.665266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:01.666464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:01.710302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 243/483] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:01.735841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:01.800004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 241/484] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:01.872381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:01.892509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b678a-e6ab-4a42-b98b-06db516ff239 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:01.968285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:01.969102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:01.969376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:01.969644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:01.983917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:02.007202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:02.018785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 244/485] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:02.028399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.044668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258e51b-8a71-4ac5-b296-dfb97344a3ad None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.137238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.137992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.138415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.138697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.146587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc36c10-9b4b-4176-9fb8-7ad7ab1de03e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.174495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:02.182024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:02.183605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 242/486] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:02.188374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.189292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.190355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.193607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.194119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.195913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:02.198344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.199819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.215794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 245/487] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:02.219302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.327238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f95e-7737-49da-bfe5-4dba61fa0384 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.347996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff58d7e-6bd0-462b-8f35-6ee438ffdabb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.365626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.366543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.367072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.367524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.368421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:02.368874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.370440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451ec4-0f3b-41c7-a910-cb205de9dc3a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.378531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 243/488] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:02.380210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b2b1-0a4f-41ed-887a-65bfde86a1b4 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.380711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b2b1-0a4f-41ed-887a-65bfde86a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.381241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b2b1-0a4f-41ed-887a-65bfde86a1b4 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.383873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 244/489] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:02.384912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b2b1-0a4f-41ed-887a-65bfde86a1b4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.386143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.386932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.387427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.387843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.402217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.405321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.427584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-39e3af6d-849f-4ad5-88da-fe4e5199183b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:02.429714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 246/490] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:02.431154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.431563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.431960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.453742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:02.455442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:02.498389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b2b1-0a4f-41ed-887a-65bfde86a1b4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.534545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.535726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.536211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.536686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.538166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 247/491] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:02.539340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.548759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.550774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.568955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:02.570990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 245/492] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:02.574249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.645675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6fc1f-217c-4256-988f-e7cb25c4cb38 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.680426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.681094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.681379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.681610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef488-410a-43e5-a9eb-8462031733c2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.682093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.682404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:02.682707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.684131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.695185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 248/493] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:02.700414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.719800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1127-f9a5-4baf-a622-98a74eee5713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.720639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1127-f9a5-4baf-a622-98a74eee5713 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.720922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1127-f9a5-4baf-a622-98a74eee5713 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.721196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1127-f9a5-4baf-a622-98a74eee5713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.737382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a1127-f9a5-4baf-a622-98a74eee5713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:02.744804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-637a1127-f9a5-4baf-a622-98a74eee5713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:02.752195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 246/494] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:02.752195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c19c8-c759-4e14-9659-7bf17061b243 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.752195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c19c8-c759-4e14-9659-7bf17061b243 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.752195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c19c8-c759-4e14-9659-7bf17061b243 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.752195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 247/495] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:02.752195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c19c8-c759-4e14-9659-7bf17061b243 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.812326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc837c0-4385-447f-b739-b5885ef9c365 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.847211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.847885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.848165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.848439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.849156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:02.849467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.850917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.855272 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c19c8-c759-4e14-9659-7bf17061b243 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:02.862705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 249/496] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:02.866186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:02.891215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:02.892015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.892298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.892576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.899541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:02.900951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:02.915394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2e615dfa-950a-4ed3-98a0-0e6e9eada844 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:38:02.921543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 248/497] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:02.921543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:02.921543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:02.921543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:02.939195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:02.940381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:02.981021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53d096-3cb3-45bd-8d93-d1667d4875ff None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.007717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 249/498] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:03.008951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.031003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.032105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.032633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.032915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.034193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:03.034666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.036073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.044215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 250/499] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:03.045500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.114453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc605712-cca8-46ed-8d3e-a4dfb84c014e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.142882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc539-2bfc-45ab-96ad-18665d2d5b46 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.146648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.147450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.147730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.148005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.154932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.156299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.170594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 14:38:03.171756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 250/500] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:03.172520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.174548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.175401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.176457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.176739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.177596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:03.177947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.179386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.215670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 251/501] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:03.216579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.266593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdebd4-cd8b-4628-86f2-3a0791911c9c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.298576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156540b-4441-4d11-90b2-fc381b4fc8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.299372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156540b-4441-4d11-90b2-fc381b4fc8a9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.299660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156540b-4441-4d11-90b2-fc381b4fc8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.299938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156540b-4441-4d11-90b2-fc381b4fc8a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.308937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638045-5e20-4f1f-a94f-fb5189965cb5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.309616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156540b-4441-4d11-90b2-fc381b4fc8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:03.317370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-4156540b-4441-4d11-90b2-fc381b4fc8a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:03.318548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 251/502] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:03.319724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b868d-c59f-4070-a3cd-a211a41c9030 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.320002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b868d-c59f-4070-a3cd-a211a41c9030 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.320273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b868d-c59f-4070-a3cd-a211a41c9030 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.321920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 252/503] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:03.322609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b868d-c59f-4070-a3cd-a211a41c9030 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.348695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.349486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.349767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.350061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.359888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.361356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.378273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:03.379428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 252/504] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:03.380197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.422142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b868d-c59f-4070-a3cd-a211a41c9030 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.454621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.455279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.455563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.455837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.456653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:03.456961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.458422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.473664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf4350-c460-4d7a-a6bb-641ea468cb21 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.493429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 253/505] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:03.494197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.513223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.514374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.514724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.514997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.577699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.579215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.588044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027459-a5f7-4709-98c9-f009402ce226 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.621783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.622483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.622768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.623039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.623770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:03.624071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.625421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152fee-978e-471f-9dbd-4bb8939fd7e2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.632802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 254/506] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:03.633978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.634279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.634533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.650035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:03.651207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:03.671928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 253/507] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:03.672815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.714482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 255/508] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:03.715328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.764042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f44d6-77ae-4d94-a4b8-6fef2b9f7ac0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.796226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.796885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.797168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.797442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.798192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:03.798494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.799885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.810806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 254/509] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:03.811513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:03.821464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad8f66-a8b2-42bb-8c51-c15b4c3ca6d1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.854027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.854667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.854952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.855229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.903439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a47c5-d781-4797-ad8c-e4e072e79aff None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:03.922355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.923975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.934856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:03.935897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:03.936177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:03.936445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:03.948599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:03.950254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:03.968158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:03.969337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 255/510] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:03.970140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.025699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 256/511] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:04.026574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.063721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825355-cb8a-4e32-867b-feee97470f1a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.094969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.095748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.096024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.096292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.106060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.107852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.118579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e2a0e-5122-4885-9ca0-319126d14b09 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.124188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:04.130138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 256/512] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:04.130138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.151734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.152519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.152802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.153072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.162920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.164388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.181330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:04.182448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 257/513] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:04.183224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.220239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2e35-2fab-4762-8311-90f481f4486b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.251525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.252322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.252604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.252886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] PATH_INFO: `/v3/users/glance` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.260128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.261588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.275546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 14:38:04.276703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 257/514] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:04.277515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.277806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b235-4505-4a1b-bffd-606d749104ae None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.310588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.311216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.311500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.311775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.312486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:04.312794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.314216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.324842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 258/515] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:04.326297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.372362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f876-ed30-4e67-a6ca-9857490ef10a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.404161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.404950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.405225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.405495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.415433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.416863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.418154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f04f-eff6-431a-bd0e-a7def97d4a90 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.433348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:04.434467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 258/516] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:04.435801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.452076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.452736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.453025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.453302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.454044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:04.454353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.455706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.467416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 259/517] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:04.468202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.529971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752368cf-46bc-4cf2-880a-e9ae0cf3594c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.562187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd527d-a3c9-496c-9a6f-37aaa21fe279 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.562666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.563327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.563607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.563881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.564597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:04.564903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.566326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.577676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 259/518] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:04.578613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.594480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.595144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.595422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.595698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.596506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:04.596809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.598246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.614873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 260/519] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:04.615655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.673000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3530-c40e-42df-a3fe-325bf0c2c84b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.706898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.707622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.707898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.708168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.708309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffee09-7b40-4797-954a-44a849151ce0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.714881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.716855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.730509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 14:38:04.731664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 260/520] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:04.733547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.740606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.741267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.741550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.741829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.742574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:04.742881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.744242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.755504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 261/521] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:04.756276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.827860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615ff9d-cf68-48dd-bcd4-79061c8eef14 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.847812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8efea-0e9b-489d-bece-96b974032b9d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:04.860660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.861446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.861728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.862029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.868390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.869839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.879730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:04.880385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:04.880668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:04.880946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:04.881632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:04.882883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:04.883096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:04.884036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 261/522] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:04.884796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.901834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 262/523] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:38:04 2022] POST /identity/v3/users => generated 247 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:04.902658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:04.992284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04e01-9ce6-471b-844c-130c84dcd3e3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.010963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dffe00-c9f8-4233-880f-d86f4e9eec79 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.027294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.028018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.028302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.029336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.047135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.047828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.048113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.048496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.049248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:05.049561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.051116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.069786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 263/524] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:05.070868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.100746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.102166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.176931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1525a-5240-4208-a055-4c79b4cdc779 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.206160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 262/525] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:05.207012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.213432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.214256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.214540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.214809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.222492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.224089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.238010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:05.243941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 264/526] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:05.243941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.304733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32676-551f-4885-b8a2-898e3e583f84 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.337587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.338289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.338570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.338844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.339612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:05.339922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.341500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.343452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfcab3-3f3b-44ee-b9d6-679b1b977545 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.364224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 263/527] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:05.364224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.377218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.377904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.378176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.378448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.445004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.446490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.457469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524af15d-924e-47bc-9dcc-c96251cad4bc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.491188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.491988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.492327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.492541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.503117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.504525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.521293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:05.526869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 264/528] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:05.526869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.543292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 265/529] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:05.544902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.622105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b828465-4947-4b62-bc62-bef3ea1bb17c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.641962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4403b-1465-4efb-93a5-ddc41a030e69 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.656183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.656619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.656941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.657176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.657994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:05.658303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.659750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.676602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 265/530] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:05.676602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.680103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.680764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.681049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.681731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.682602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=54185e0e2c5549f3b397a8009ae27713) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:05.682919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.684342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.690532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 266/531] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/role_assignments?user.id=54185e0e2c5549f3b397a8009ae27713&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:05.691318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.786598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdcd20-c4bb-4fa1-a0f3-1bad30d5e642 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.801017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d13b0-ffdb-4379-bd75-520797b73ce4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.822515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.823194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.823472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.823744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.824736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:05.824736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.826791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.839831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 266/532] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:05.840313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:05.840701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.842230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:05.842744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:05.843227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:05.854681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:05.856480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:05.875605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:05.881763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 267/533] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:05.883084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:05.956546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb362-1ac5-40f0-9495-468fd214024f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:05.995537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ca85-be93-4e10-9d80-85d62adc9c24 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.002542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.003876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.004366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.005172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.006599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=faa371f194b149bd86f53b5de40bb719) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:06.007388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.009584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.018303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 267/534] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/role_assignments?user.id=faa371f194b149bd86f53b5de40bb719&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:06.019472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:06.063380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.064147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.064431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.064709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.086951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.088428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.118938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:06.120204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 268/535] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:06.130993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:06.158621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b6e0-da46-4168-9e0b-739cbcca19d5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.210687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.211377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.211655 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.211929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.212732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:06.213044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.214600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.232464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 268/536] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:06.247024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:06.255202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f570dc5-2d56-48de-b9bd-49535eed26e1 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.289387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.290140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.290427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.290698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.291475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:06.291780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.293203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.311730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 269/537] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:06.318761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:06.397903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bb04a-58bc-48e0-91eb-3f1c0d6ab3e4 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.439484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.440299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.440578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.440849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.454958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.456417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.468721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f610fa-f27c-4348-a82f-1a14a4c5f1d4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.482443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:06.490386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 269/538] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:06.495738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:06.504754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.505749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.506340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.506833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.508723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=8a7848c76d664adc9df92ab214c0c7f9) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:06.509258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.510967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.517704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 270/539] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:06 2022] GET /identity/v3/role_assignments?user.id=8a7848c76d664adc9df92ab214c0c7f9&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:06.646417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf7ff3-f01e-41fa-9ae9-7bdc37da1f44 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.683192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.684690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.685209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.685694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.686713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:06.687284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.689039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e80b-6440-4d93-821a-7ddc86460dac None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.703524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 270/540] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:06.714997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:06.825264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704de12-b2b7-420a-b191-5706a3c411b2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:06.861576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:06.862640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:06.863138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:06.863624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:06.864653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=e45b81aa59fd4b26bc1434c9191c20ef) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:06.865176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:06.866941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289b0b-fe40-486d-876f-0a972771cff8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:06.873474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 271/541] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:06 2022] GET /identity/v3/role_assignments?user.id=e45b81aa59fd4b26bc1434c9191c20ef&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:07.509064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab626bd-61d9-49ec-88e5-1618520eb46e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:07.509445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab626bd-61d9-49ec-88e5-1618520eb46e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:07.509653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab626bd-61d9-49ec-88e5-1618520eb46e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:07.511665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 271/542] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:07.518700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:07.518987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:07.519264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:07.539201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:07.540388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:07.617573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 272/543] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:07.652832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab626bd-61d9-49ec-88e5-1618520eb46e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:07.780147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab626bd-61d9-49ec-88e5-1618520eb46e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:07.821805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:07.822629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:07.822909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:07.823178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:07.838560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:07.846019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:07.847223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 272/544] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:07.853096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:07.980691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa67634-9e5c-44a4-8228-9cfce71bfd71 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:08.021381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:08.022088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.022368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.022647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.023392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:08.023695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:08.025058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:08.042848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 273/545] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:08.048632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:08.216023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63283-79e2-4ca4-908b-b66dff78723d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:08.268459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:08.269265 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.269547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.269821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.287146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:08.288620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:08.311636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-c509cd21-c223-454c-9183-5f3895912089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:08.312775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 273/546] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:08.318302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:08.473930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d0ee-f989-490b-8c66-f6f66a08de19 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.474311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d0ee-f989-490b-8c66-f6f66a08de19 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.474517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358d0ee-f989-490b-8c66-f6f66a08de19 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.480679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 274/547] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:08.482758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.482963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.483362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.499040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a17c-0681-4e65-be73-b711b1bd8d72 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:08.518243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:08.519783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:08.540215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:08.540890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.541172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.541451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.542199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:08.542509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:08.543884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:08.579034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 274/548] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:08.583516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:08.642954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 275/549] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:08.677952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:08.790943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3a53-f7a8-4cc7-8a46-0e0f4957cf6d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:08.823792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c556-cdcd-45eb-b8e2-534f9dde5150 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:08.837559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04d77-1558-49ab-a092-981365fcf352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:08.838724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04d77-1558-49ab-a092-981365fcf352 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.839208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04d77-1558-49ab-a092-981365fcf352 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.839680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04d77-1558-49ab-a092-981365fcf352 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.864863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d04d77-1558-49ab-a092-981365fcf352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:08.879585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-94d04d77-1558-49ab-a092-981365fcf352 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:08.880964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 276/550] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:08.882384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedeb44-bd8e-4337-aa1b-e5e433779623 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.882670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedeb44-bd8e-4337-aa1b-e5e433779623 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.882941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedeb44-bd8e-4337-aa1b-e5e433779623 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.885384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 277/551] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:08.886825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedeb44-bd8e-4337-aa1b-e5e433779623 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:08.891115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:08.892522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.893037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.893566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.901331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:08.903089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:08.918471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-05c10886-01c6-4a2a-9f0e-5cd3fced3182 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 14:38:08.920561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 275/552] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:08.922186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:08.922687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:08.923156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:08.944020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:08.947345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:09.008055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedeb44-bd8e-4337-aa1b-e5e433779623 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.014196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 276/553] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:09.015565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.048751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.049703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.050253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.050715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.051650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:09.052175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.053952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.063908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 278/554] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:09.069404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.133188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049cf1e-43a4-4c49-88e2-e6b39c3bb7f6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.166730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.167443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.167729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.168015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.168823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:09.169834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.171189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.172907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23d0be-64b5-4b54-855b-cd6967e9c5e7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.192831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 277/555] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:09.192831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.213229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.214359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.214832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.215270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.228401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:09.236405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:09.238261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 279/556] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:09.239260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.293728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b106-cf9d-45c1-b357-fd923e6d49aa None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.329099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.329928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.330212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.330481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.340573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.342175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.345195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5a5ae-33fa-44ec-b539-c2d64c5b5b82 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.359579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:09.360774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 278/557] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:09.361554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.382100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2bea-64cc-4ec1-a352-c7b08400e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.383024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2bea-64cc-4ec1-a352-c7b08400e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.383509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2bea-64cc-4ec1-a352-c7b08400e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.383991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2bea-64cc-4ec1-a352-c7b08400e3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.451568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2bea-64cc-4ec1-a352-c7b08400e3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.453039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2bea-64cc-4ec1-a352-c7b08400e3d9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.465037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164b02-77c0-41a4-97df-9727674840dc None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.500045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.500740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.501024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.501299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.502097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:09.502415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.503847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.517657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 279/558] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:09.517657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.561225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 280/559] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:09.562601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5bc4-5d4b-4559-8d07-19ea845912ce None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.562888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5bc4-5d4b-4559-8d07-19ea845912ce None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.563163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5bc4-5d4b-4559-8d07-19ea845912ce None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.564950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 281/560] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:09.565523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5bc4-5d4b-4559-8d07-19ea845912ce None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.627061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39733a9-05b1-471e-8cf1-c4a39680de6b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.662552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.663138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.663422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.663702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.664421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:09.664738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.666139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01daab-7379-4875-bf5c-e46bf69ddb91 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.670963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5bc4-5d4b-4559-8d07-19ea845912ce None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.683083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 280/561] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:09.683083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.683083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.683083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.698138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:09.699324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:09.708546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.709346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.709625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.709983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.721045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.722547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.739722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:09.741129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 282/562] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:09.742057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.772476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 281/563] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:09.773324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.848118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f276e-3cb6-4318-998e-563ce00d1bd3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.869018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581989-fc51-4cd8-9b53-aa1c7dd01146 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:09.880227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.881016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.881290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.881572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.891856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.893293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.901510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:09.902318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:09.902601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:09.902873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:09.910445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:09.910764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:09.911885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:09.912028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 283/564] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:09.912746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:09.927807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:38:09.928979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 282/565] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:09.929730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.014119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e7583-5e2d-4e72-8f2a-f08afc306510 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.023754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58fc74-df43-4e5c-92e3-ac127e2fbb8e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.046248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.046926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.047211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.047486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.048202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.048539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.050002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa347290-4cdb-40be-9b95-0942cee27fa7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.054719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.055502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.055782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.056057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.061643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 284/566] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.062945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf6a8-7e82-468d-8713-d93343fefbf8 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.063243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf6a8-7e82-468d-8713-d93343fefbf8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.063522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf6a8-7e82-468d-8713-d93343fefbf8 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.065172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 285/567] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:10.065932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf6a8-7e82-468d-8713-d93343fefbf8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.067331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:10.074497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:10.076238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 283/568] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:10.077238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.165062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf6a8-7e82-468d-8713-d93343fefbf8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.168824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f035e9-6ba1-4cb1-8dfa-2f92cae24d86 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.196369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.197023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.197311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.197581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.198323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.198629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.200015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.201052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.201875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.202169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.202442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.203250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.203556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.204968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2226c-4ce4-4f76-8d9f-aa761693446c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.211659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 286/569] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.212445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.222166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 284/570] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.223458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.223740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.224010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.240317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:10.241481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:10.303850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 285/571] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:10.304748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.317035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28166117-7059-4d4e-80a7-1c9b1e11ee95 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.349804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.350617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.350897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.351156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.358616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.360042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.373320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 14:38:10.374489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 287/572] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:10.375244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.398111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6bd3d-edea-4378-aea1-c9ddddb39d51 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.430492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.431083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.431366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.431638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.432363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.432664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.434041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.441686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 286/573] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.442487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.467550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef15d-d35c-4de5-8371-bf7e76f7c1be None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.499481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.500267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.500550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.500825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.507230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.508684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.522123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:10.523272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 288/574] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:10.524038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.535551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040688e-42f8-4aeb-8fc5-482a06221048 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.566866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.567649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.567926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.568195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.579889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.581314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.597922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:10.599086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 287/575] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:10.599929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.622476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57156-9cc9-4649-9a1a-ee2518ecec74 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.654792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.655581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.655859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.656129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.665718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:10.673217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:10.674416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 289/576] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:10.675176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.695416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03cee-17aa-4039-938d-c1090855e06e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.727849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.728510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.728790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.729062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.729944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.730210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.731655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.748274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 288/577] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.749089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.768395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886cb41-9414-41f4-8ac2-a567288a822b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.799679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.800464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.800743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.801016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.811520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.812964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.829432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:10.830620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 290/578] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:10.831385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.842619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e252a9-e25c-437a-9ff4-20867c875599 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.874436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.875088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.875366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.875638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.876399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.876703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.878151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.889728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 289/579] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.890378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.931553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6b93-013e-43d8-8985-316c2db89f77 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:10.965359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:10.966007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:10.966817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:10.967097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:10.967807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:10.968113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:10.969497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:10.980819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 291/580] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:10.981713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:10.986108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea15a9-756d-4380-9536-cd1f30b407b4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.018614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.019285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.019569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.019845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.020580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.020888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.022303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.029810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 290/581] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.030609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.078614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163587-32ff-4be5-9806-87947b236a66 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.110958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.111747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.112027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.112298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.121999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.124159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.125437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fec47-81c5-4757-8250-7a3e18a83d58 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.141202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:11.142391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 292/582] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:11.143191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.158279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.158939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.159221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.159494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.160204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.160511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.161898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.174210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 291/583] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.175000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.237638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bb6a-f2d4-4bbb-a6cc-a91bbb0750bd None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.267729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d8c0-e8ab-43e3-88a7-57858dc782b9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.270035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.270688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.270961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.271230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.272036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=e5b56d7d7db04439a40f4a02b9ad8135) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.272345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.273774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.280099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 293/584] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/role_assignments?user.id=e5b56d7d7db04439a40f4a02b9ad8135&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.280882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.302209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.303024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.303308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.303578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.311392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.312855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.327783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:11.329023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 292/585] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:11.329797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.391560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49447fb-d0fc-4803-b592-5dc60257bf93 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.428386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.429199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.429563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.429750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.433016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b177b-925b-4a1b-bf49-189b6b9fb546 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.440477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.442001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.460912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:11.462172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 294/586] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:11.462958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.468034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.468706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.468997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.469316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.470069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.470369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.471731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.484563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 293/587] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.485673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.568177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb592b-6baf-4890-b447-6430fe2f3a39 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.584974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff1e-0ed4-44f3-bdcc-58b76236aaa0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.602020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.602826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.603113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.603381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.610779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.612245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.620157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.621041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.621506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.622072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.623643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.624144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.625784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.626732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 14:38:11.627925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 295/588] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:11.628712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.649424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 294/589] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.649424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.737427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870b14-72fc-4cf5-91bf-114993bfc833 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.748207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf875f-c04e-4b3e-b1d5-9fb67415b6d5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.772670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.773615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.774105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.774529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.775386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.775861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.777268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.780693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.781495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.781845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.782154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.788642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.790097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.792745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 296/590] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.793473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.804052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:11.810194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 295/591] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:11.810194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.890750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02834a03-a012-4d8a-856d-e352d11522dc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.907495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad474-2890-4cbd-92e5-08c1d0bcf20b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:11.924247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.925239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.925717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.926221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.927229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:11.927743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.929367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.943242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:11.944144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:11.944429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:11.944712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/54185e0e2c5549f3b397a8009ae27713/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:11.948092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 297/592] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:11.948707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:11.970864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=54185e0e2c5549f3b397a8009ae27713, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:11.972330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:11.989911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 296/593] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:11 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/54185e0e2c5549f3b397a8009ae27713/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:38:11.989911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.050243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cefa3-c02c-4c06-95d8-8b52263b4d91 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.087451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.088270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.088550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.088819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.097001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.098522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.100666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b847f-0573-4c7a-8f7c-1063ee4f5b8d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.114250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 14:38:12.115820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 298/594] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:12.116604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.137465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.139069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.139359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.139641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.140431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:12.140745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.142320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.155698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 297/595] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:12.156602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.229272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb8f44-f15e-49e3-95a5-6e34c943655f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.262063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fedde-8041-439f-9b02-376b056963ea None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.266121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.266935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.267215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.267491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.278016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.279823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.296011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.296682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.296966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.297245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.298099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:12.298405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.299840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.301800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:12.303326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 299/596] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:12.304091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.317634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 298/597] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:12.318499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.407483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e643ff1-8d9d-46c9-bcaf-cf40efd450d2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.417426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fdc2d-0b8e-4b9b-9e8f-d198a3f81772 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.451195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.452765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.453196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.453715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/faa371f194b149bd86f53b5de40bb719/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.454239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.454900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.455184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.455458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.456181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:12.456486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.457882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.469787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 299/598] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:12.470484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.474955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=faa371f194b149bd86f53b5de40bb719, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.476639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.491296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 300/599] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:12 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/faa371f194b149bd86f53b5de40bb719/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:38:12.492454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.603016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f698-ee17-4420-bbb2-3b8da406bd44 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.603355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14ede4-7259-455f-b8f6-371f1faa9ad3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.670722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.671833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.672466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.673383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.680002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.681087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.686188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.686432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.686736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.688628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.703893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:12.705888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 301/600] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:12.707892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.709395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.719191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.745744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:12.755903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 300/601] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:12.761294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.826852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb254e-a4bb-4c67-99f1-eccc853716df None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.860654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:12.861319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:12.861595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:12.861879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:12.862668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:12.862973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:12.864420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:12.877777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 302/602] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:12.883057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:12.990529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff2a1e-4a6f-49c9-a2f6-bf2a8473b475 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:12.998391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d43698-7144-4095-90dd-ca8cbd64df4e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:13.030249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:13.031464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.031740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.032010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/8a7848c76d664adc9df92ab214c0c7f9/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.048819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=8a7848c76d664adc9df92ab214c0c7f9, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:13.050441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:13.069329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 303/603] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:12 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/8a7848c76d664adc9df92ab214c0c7f9/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:38:13.073582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:13.074307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.074588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.074864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.075882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:13.076193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:13.078119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:13.094029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 301/604] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:13.103047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:13.207166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd6d6-da87-4549-adb3-171bfad1ebd1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:13.243478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:13.244334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.244613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.244930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.252000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:13.253496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:13.267867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:13.269508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 304/605] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:13.275085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:13.405847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0285ca9-204d-4557-97ad-9998df518207 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:13.440590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:13.441248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.441533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.441804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.442613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:13.442921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:13.444404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6d84-02c3-4775-85e1-c18b9e1badf5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:13.458720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 302/606] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:13.464683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:13.605419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c825f3-72f9-4d10-9911-3928ccc480c3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:13.656637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceee500-4469-4c78-b98e-794472eb775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:13.657538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceee500-4469-4c78-b98e-794472eb775b None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.657817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceee500-4469-4c78-b98e-794472eb775b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.658109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceee500-4469-4c78-b98e-794472eb775b None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/e45b81aa59fd4b26bc1434c9191c20ef/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.681000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceee500-4469-4c78-b98e-794472eb775b None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=e45b81aa59fd4b26bc1434c9191c20ef, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:13.682582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceee500-4469-4c78-b98e-794472eb775b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:13.711773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 305/607] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:13 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/e45b81aa59fd4b26bc1434c9191c20ef/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:38:13.932483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f827b5-47ce-4318-80cc-f9aeee2a29ab None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.932950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f827b5-47ce-4318-80cc-f9aeee2a29ab None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.933144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f827b5-47ce-4318-80cc-f9aeee2a29ab None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.937745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 303/608] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:13.942557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:13.943105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:13.943657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:13.976648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:13.978268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:14.068883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 306/609] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:14.093173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f827b5-47ce-4318-80cc-f9aeee2a29ab None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:14.203879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f827b5-47ce-4318-80cc-f9aeee2a29ab None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:14.238391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:14.239116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:14.239394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:14.239668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:14.251672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:14.258835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:14.265150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 304/610] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:14.266617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:14.403308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303db200-2e97-4f2d-b02e-5ee27181abc1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:14.451753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:14.452434 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:14.452713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:14.452987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:14.453730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:14.454059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:14.455444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:14.469457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 307/611] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:14.474679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:14.626073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dac13f-fbeb-464f-b674-d5f12539a634 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:14.678571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:14.679377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:14.679658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:14.679933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:14.690580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:14.692026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:14.719635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-33b78380-b32f-40c6-b510-f7109b547de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:14.721202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 305/612] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:14.726552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:14.761426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f24f7-47c9-4b3c-b32a-54f2cd30df45 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:14.761737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f24f7-47c9-4b3c-b32a-54f2cd30df45 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:14.761990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f24f7-47c9-4b3c-b32a-54f2cd30df45 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:14.764422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 306/613] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:14.770821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:14.771099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:14.771374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:14.805619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:14.806851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:14.911259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeda56-639b-461d-9bd5-2d1fe15175f7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:14.923899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 307/614] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:14.953943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:14.953943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:14.953943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:14.953943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:14.954330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:14.954330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:14.954981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:14.963434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:14.978005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 308/615] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:14.984069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.105374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec1534-e704-4c74-8bbc-68314dc9a991 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.120766 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc897-89f9-4812-836d-289c50fda98a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.157532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.158713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.159219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.159684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.167754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.170047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.186336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.186981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 14:38:15.187157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.187427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.187703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.189337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 309/616] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:15.194889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.219117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:15.232498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:15.234833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 308/617] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:15.242568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.360043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0ac4-7be5-4dd1-a232-16b0ad78a672 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.366883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ac1ca-8e99-4305-b2e5-ef860bf7dccd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.396375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.397199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.397481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.397755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.398928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:15.399254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.400958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.403890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.404810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.405344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.405815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.406805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:15.407320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.408889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.417934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 309/618] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:15.423257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 310/619] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:15.424447 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.429432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.561454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fcbd4-6973-4fda-8ea8-80e8a936b910 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.562321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc613be-4bb3-4e89-87fe-06329ccb16e7 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.605322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.606191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.606542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.607384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.607982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.609027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.609747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.610631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.618519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.619967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.623694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.625366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.636646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-311d9275-959c-497e-a3e6-f2486f822e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:15.638204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 310/620] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:15.639553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781999a8-ae0f-4e9e-8b45-184bb5679f38 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.639840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781999a8-ae0f-4e9e-8b45-184bb5679f38 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.640118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781999a8-ae0f-4e9e-8b45-184bb5679f38 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.641779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 311/621] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:15.645904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-e2175b9a-fbdb-490c-8410-0efd80ca32b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:15.646540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781999a8-ae0f-4e9e-8b45-184bb5679f38 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.647890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 311/622] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:15.649611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.651026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.651515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.672191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:15.674186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:15.753533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781999a8-ae0f-4e9e-8b45-184bb5679f38 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.760477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 312/623] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:15.761512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.812934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.813758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.814411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.814411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.815251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:15.815668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.817169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.829928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 312/624] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:15.830903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.880009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a2f69-f140-404c-9e44-4be3b578ec5d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.925153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.926365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.926981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.927737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.928894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:15.929380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:15.930146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61303d-0a38-417a-b321-904254342bf1 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:15.931176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:15.951703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 313/625] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:15.953109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:15.968330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:15.969125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:15.969400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:15.969667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:15.979357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:15.986857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:15.988026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 313/626] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:15.988783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.065989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df833eea-3d7c-4ae0-b5a0-ff6cc5d8d834 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.087701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f01b1-abb2-4152-afda-36025c63d7ea None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.100342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.101134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.101409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.101678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.109134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.110626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.119899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.120700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.120985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.121261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.124466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ffdec5a8-087a-4a12-aede-2fe9ea7b61b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:38:16.130144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 314/627] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:16.130144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64aed-48c0-4519-b2ee-1aa54720321f None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.130144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64aed-48c0-4519-b2ee-1aa54720321f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.130144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64aed-48c0-4519-b2ee-1aa54720321f None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.130144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 315/628] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:16.130144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64aed-48c0-4519-b2ee-1aa54720321f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.134268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.135739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.149939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:16.156535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 314/629] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:16.156535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.235114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64aed-48c0-4519-b2ee-1aa54720321f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.251855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10cbc-706f-4d4d-9fc2-be14b30aa67e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.267922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.268850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.269373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.269797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.270737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:16.271202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.272809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aac6d3-ff97-4840-9aeb-e582be08ec00 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.282489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 316/630] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:16.284076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.284368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.284644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.290565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.291262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.291537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.291806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.292641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:16.292949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.295156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.304673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:16.305898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:16.317568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 315/631] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:16.317568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.396987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 317/632] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:16.396987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.410472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3b3c-0097-4c2b-a81e-169e385a4167 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.446544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.447201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.447482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.447757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.448526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:16.448832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.450412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.466794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 316/633] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:16.466794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.501818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a8a13-5d84-4991-8129-97b8f8c43767 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.534558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.535355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.535638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.535913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.547109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.548656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.566301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:16.567214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca6e1-f49f-46ce-af5d-6885776aa9d0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.571857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 318/634] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:16.571857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.606253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.607496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.607778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.608043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.669712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03ad8-377a-4078-b7c3-cda4be03bcd8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.674448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.675894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.701804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.702628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.702912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.703188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.712820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:16.721949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:16.723135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 319/635] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:16.723882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.768988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 317/636] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:16.769746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.817134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c57b31-8a3a-4ee3-bacc-8979e3e91a53 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.848645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1277-e1cc-40fe-a1c6-1260b6339d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.849525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1277-e1cc-40fe-a1c6-1260b6339d06 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.849805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1277-e1cc-40fe-a1c6-1260b6339d06 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.850106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1277-e1cc-40fe-a1c6-1260b6339d06 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/e5b56d7d7db04439a40f4a02b9ad8135/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.864031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45e77d-d2b2-4b3d-b964-0423255960f2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:16.864656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1277-e1cc-40fe-a1c6-1260b6339d06 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=e5b56d7d7db04439a40f4a02b9ad8135, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.866133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1277-e1cc-40fe-a1c6-1260b6339d06 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.878140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 320/637] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:16 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/e5b56d7d7db04439a40f4a02b9ad8135/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:38:16.879433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d601-ac3e-48c2-9bf6-7018b8c3eb98 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.879720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d601-ac3e-48c2-9bf6-7018b8c3eb98 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.879991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d601-ac3e-48c2-9bf6-7018b8c3eb98 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.886299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 321/638] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:16.886299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d601-ac3e-48c2-9bf6-7018b8c3eb98 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.903072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:16.904523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:16.904914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:16.905243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:16.906065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:16.906375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:16.907850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:16.925927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 318/639] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:16.925927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:16.992357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262d601-ac3e-48c2-9bf6-7018b8c3eb98 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.027697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.028804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.029094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.029365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.030154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:17.030462 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.031901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33426cea-74dd-440c-a189-a44b468b339a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.038440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93067-5903-47e4-9961-315e1dee7913 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.045745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 322/640] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:17.045745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.045745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.045745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.062335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:17.063831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:17.075150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.075957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.076491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.076765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.087622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.089086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.107180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:17.108501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 319/641] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:17.109286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.134261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 323/642] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:17.135123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.212096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e96ae9-c836-4704-8fd9-12c7cf6f5d75 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.238010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9e5b8-ee04-4703-884d-38ce61b640b2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.245977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.246780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.247156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.247514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.255119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.256582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.270812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 14:38:17.276508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 320/643] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:17.276656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.276765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.276850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.276850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.276850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.289192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.290643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.307891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:17.313695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 324/644] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:17.313695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.379694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee73e-f906-4877-98a1-46ee4aa672a8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.411805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.412011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f06a0-84c0-41c0-a08d-dc5be8a858f3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.412469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.412755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.413037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.413751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:17.414094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.415456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.431852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 321/645] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:17.431852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.450732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.451794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.452079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.452353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.462037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:17.469380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:17.475319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 325/646] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:17.475319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.532566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa7a6-bf3c-41ab-b61d-d2aac1750bc5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.567107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27020dd4-bc18-491f-8dda-6ba5aea532a0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.571749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.572582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.573004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.573442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.574437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:17.574901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.576898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.598750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 322/647] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:17.599846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.600539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.601204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.601488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.601763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.602517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:17.602824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.604213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.616352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 326/648] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:17.617166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.708835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc10a-fbae-4c93-864c-0ba43b904353 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.717520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2cf6-248b-4cd7-ae80-2ab530230ae8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.742317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.743365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.743471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.743736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.750337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.750554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.751063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.751347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.751616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.751979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.752355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:17.752650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.754032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.766571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 327/649] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:17.766571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.766809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:17.771399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 323/650] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:17.771399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.859689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983da0b-757c-43a4-b1c4-96714987c367 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.866076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5339731-dfc3-4296-84b0-fa1f2a7a8ac0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:17.892615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.893263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.893540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.893809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.898704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:17.899557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:17.899843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:17.900116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] PATH_INFO: `/v3/users/glance` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:17.909180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.910658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:17.924530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 14:38:17.930201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 324/651] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:17.930201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:17.966806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:17.968747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.033090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575b8c-9a19-41da-b1cc-0e4ccda2c02e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.065555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.066372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.071527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.071658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 328/652] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:18.071757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.071839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.078808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.080245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.097305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:18.103247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 325/653] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:18.103247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.161897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7bcf3-9dfe-4a04-9638-b10a4affe092 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.195553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.196207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.196308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0812d-73b8-47d3-bc4d-624edbf29236 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.196507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.196748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.197601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:18.197806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.199257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.215828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 329/654] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:18.216509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.233006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.233678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.233995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.234275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.235099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:18.235410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.236860 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.258631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 326/655] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:18.258631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.313168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b8a3f-c701-4a1c-a0e1-d59671606f3d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.345092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.345905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.346187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.346459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.352935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeda61-d0a3-43d2-b576-73dea67e24f1 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.357287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.358826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.375116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:18.376470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 330/656] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:18.377236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.391600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.392260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.392542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.392812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.393517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:18.393819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.395182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.411297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 327/657] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:18.411297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.485886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109da10-cdd5-493b-9136-0470622e4fc9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.506325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a116d-cd1f-40b0-bd73-393408d3106c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.519402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.520320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.520792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.521234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.522250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=54185e0e2c5549f3b397a8009ae27713) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:18.522746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.524304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.530564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 331/658] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/role_assignments?user.id=54185e0e2c5549f3b397a8009ae27713&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:18.531264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.547702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.548895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.550031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.550561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.642959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.645584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.647027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c02d8-573f-4658-823a-f235a48a29fd None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.688175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.688384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.688614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.688850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.689574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:18.689899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.691321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.709742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 332/659] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:18.709742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.771279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 328/660] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:18.772071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.812788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cd688-faaf-40ab-8ac4-38b4bf977f47 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.848840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.849665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.849972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.850241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.859230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.860722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.876738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 14:38:18.878615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13489986-5649-41c7-a51a-8cb6e9a46d79 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:18.881743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 333/661] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:18.882639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.915368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:18.916162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:18.916444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:18.916722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:18.924477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:18.925932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:18.940085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:18.941899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 329/662] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:18.942410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:18.985643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19a6e1-6490-476d-9398-c4104777a31e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.019791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.020588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.020864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.021134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.032912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.034341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.051649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:19.053185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 334/663] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:19.054075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.054482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a3e67-c84f-486d-b2c8-b9f6a2d18103 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.089293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.089996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.090275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.090547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.092026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:19.092420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.093834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.116299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 330/664] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Mar 8 14:38:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:19.117881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.162216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4d313-5dbc-4763-a1f2-e65fa73310da None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.198636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.199300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.199580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.199906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.201872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:19.202275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.203725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.215694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 335/665] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:19.217220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.225304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b4bdb-c415-4ccb-bc31-30b4219ffa3d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.260807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.261534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.261738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.262100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.263953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:19.264270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.265661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.276388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 331/666] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:19.277176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.332115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df86aa-dcef-486e-8656-447e86f3318d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.365153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce762200-41c4-46b8-963b-3aa8af3a28bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.365795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce762200-41c4-46b8-963b-3aa8af3a28bf None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.366098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce762200-41c4-46b8-963b-3aa8af3a28bf None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.366363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce762200-41c4-46b8-963b-3aa8af3a28bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.372744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e631-c6f0-40fa-a69d-2a61a914f330 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.405999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.406809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.407098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.407543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.408369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=faa371f194b149bd86f53b5de40bb719) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:19.408680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.410253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e034-b9ba-419a-a323-e28b32a62fab None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.416005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 332/667] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/role_assignments?user.id=faa371f194b149bd86f53b5de40bb719&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:19.417227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100d57-4816-4a72-ae2c-a9210af18fd9 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.417516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100d57-4816-4a72-ae2c-a9210af18fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.417802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100d57-4816-4a72-ae2c-a9210af18fd9 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.424352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 333/668] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:19.424352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100d57-4816-4a72-ae2c-a9210af18fd9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.449562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce762200-41c4-46b8-963b-3aa8af3a28bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.452215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce762200-41c4-46b8-963b-3aa8af3a28bf None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.565541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 336/669] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:19.566665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100d57-4816-4a72-ae2c-a9210af18fd9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.566894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.567153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.567428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.586666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:19.587805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:19.612967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.613889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.614254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.614603 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.622620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.624070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.642329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:19.647732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 334/670] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:19.649264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.683561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 337/671] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:19.684457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.769783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254907-2356-48a0-9d5b-9c9d09fa02e2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.804366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.805041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.805324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.805596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.812446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83161-702e-420a-b63f-c5ec6f33f7ec None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.818886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.820389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.839658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:19.845418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 335/672] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:19.846315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.853543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.854533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.855447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.855941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:19.857000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:19.857509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:19.859403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:19.876225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 338/673] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:19.877349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:19.957159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda774f6-af44-4276-936a-1b42030043b3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:19.990086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:19.991022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:19.991400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:19.991773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.002835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:20.007846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7a3ca-6b17-4438-8520-a414d5391ece None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.010695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:20.011519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 336/674] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:20.012377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.050346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.051233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.051724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.052142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.053035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:20.053902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.055778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.072853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 339/675] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:20.073835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.118790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbcc05-08a1-40fb-a676-e9ee087199ee None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.152715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.153613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.154040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.154415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.155333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=8a7848c76d664adc9df92ab214c0c7f9) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:20.156089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.157278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.169788 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 337/676] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/role_assignments?user.id=8a7848c76d664adc9df92ab214c0c7f9&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:20.170904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.182189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00418105-5a95-4cc2-8470-ea3de2adc7a8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.220892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.221881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.222327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.222744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.223658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:20.224115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.225739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.235463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 340/677] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:20.241275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.367435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009d272-1535-4e20-8cd2-b38cef32fd23 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.416383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.417118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.417542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.418146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.425157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bdaab-bab1-470c-b527-99e72017f0b5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.427180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.429448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.452034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:20.457934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 338/678] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:20.459170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.465562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.466965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.467241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.467510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.482351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.483820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.504999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:20.506975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 341/679] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:20.514580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.577623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d098b-6864-4317-97cc-62127fdae592 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.617585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.619647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.619927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.620232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.621059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:20.621370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.623183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.638001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 339/680] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:20.641305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd82cc-3534-4345-afc6-0da5b01fc172 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.641842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.685160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.686121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.686404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.686676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.687406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:20.687709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.689746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.707104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 342/681] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:20.712908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:20.758114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30d3cb-e429-43a9-8014-58a3161cc75b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.801618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.802302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.802582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.802857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.803669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=e45b81aa59fd4b26bc1434c9191c20ef) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:20.803975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.805401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.814201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 340/682] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/role_assignments?user.id=e45b81aa59fd4b26bc1434c9191c20ef&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:20.836843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49da509-a275-4555-964f-20db03f6b8b0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:20.874224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:20.875032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:20.875309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:20.875584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:20.883271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:20.884824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:20.900750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 14:38:20.902407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 343/683] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:20.911020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.032248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5b2ce-8072-49e7-9a57-1efacd111845 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.067927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.068605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.068886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.069161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.070028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:21.070333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.071775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0ae5-6e9c-45eb-9d1c-489da34f96cf None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.090666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 341/684] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Mar 8 14:38:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:21.098995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.120753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1271f-98d2-4cb5-b17b-7fa951b3fd19 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.121060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1271f-98d2-4cb5-b17b-7fa951b3fd19 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.121291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1271f-98d2-4cb5-b17b-7fa951b3fd19 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.125267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 342/685] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:21.130765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.131053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.131334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.165524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:21.166782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:21.217204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55140c-7994-422d-bc4f-9f7c68e8a709 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.236829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 343/686] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:38:21.257382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.258417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.258922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.259410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.260056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.329331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.331161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.365356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51557284-c673-49cf-8bda-e796a64ab8a0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.399453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.400279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.400561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.400836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.412350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:21.420426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:38:21.422012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 344/687] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:21.427731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.433031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 344/688] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:21.438705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.533147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419a57a-53e9-4e3b-96f8-e806202f046b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.537690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9eb64-9149-4cc5-8da0-65cb60820571 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.567232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.567901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.568416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.568416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.569188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:21.569460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.570860 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.573905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.574934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.575727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.576458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.579724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 345/689] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:21.585087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.587628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.589313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.608700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:21.610550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 345/690] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:21.616101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.705469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6c7d-6f43-435a-900e-2d61148e94a6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.718634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445412d-20ae-46cc-8c23-cbffa4d77593 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.739737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.740539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.740818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.741090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.752884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.754345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.755369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.756288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.756763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.757227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.758188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:21.758707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.760269 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.771090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:21.772563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 346/691] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:21.773340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 346/692] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:21.777936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.779060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.877105 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a4683-296c-4e73-8c9b-eed010122ebc None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.878624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0544020-b7de-49fc-971d-d3a574da446b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:21.913585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.914840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.915267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.915681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.916319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:21.917095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:21.917474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:21.917844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:21.918710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:21.919114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.920571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.924042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:21.925784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:21.933258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 347/693] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:21.939578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:21.953354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:21.955285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 347/694] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:21.960845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.039581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ff8b1-e852-463b-bb1b-6ed1acd95b8f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.059668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771ad00-df14-42f6-b74e-d29829406688 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.074282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.075120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.075555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.075832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.083115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.084533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.098842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.099014 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c11c9b94-d620-48b6-a4d0-915f5dc8dc76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:38:22.099763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.100132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.100383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 348/695] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:22.100636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.101560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:22.101672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d8be-c906-46a4-8275-b40b429615c1 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.101878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d8be-c906-46a4-8275-b40b429615c1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.102147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.103683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf82cf-25e9-4a9e-86fa-bb7d98b6e674 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.106372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d8be-c906-46a4-8275-b40b429615c1 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.108535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 349/696] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:22.109731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80d8be-c906-46a4-8275-b40b429615c1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.116656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 348/697] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:22.123703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.124130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.124901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.147453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:22.148878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:22.218550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80d8be-c906-46a4-8275-b40b429615c1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.236954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 349/698] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:22.237820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.253779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.254527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.254806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.255113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.255996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:22.256302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.257781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.276838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 350/699] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:22.282739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.339110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04573739-73f0-45e1-ac23-dc6aec02e88c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.373406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.374089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.374370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.374645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.375457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=e5b56d7d7db04439a40f4a02b9ad8135) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:22.375764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.377195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.381015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aecec0-04bc-4504-8a91-fa69a9f9fa93 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.383253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 350/700] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/role_assignments?user.id=e5b56d7d7db04439a40f4a02b9ad8135&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:22.384049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.417096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.417871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.418177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.418447 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.419352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.420784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.434729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 14:38:22.436285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 351/701] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:22.442584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.570870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de50c17-ab95-4515-9e63-b9cc2c0b94d2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.614600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.615253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.615431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e40ba0-2530-4beb-8f55-ab269fbcf402 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.615588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.615787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.674889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.675926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.676415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.676893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.677801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:22.678392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.680039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.686447 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 352/702] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:22.692221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.699464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.701720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.817156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8333-c224-4c47-b62d-7038f192988e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.820223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 351/703] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 14:38:22.825055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:22.861275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.862350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.862869 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.863348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.864274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:22.864791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.866455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:22.873528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 353/704] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:22.934177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104713c5-a5a5-4752-aa26-10c7a1b6d926 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:22.977493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:22.978334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:22.978617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:22.978890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:22.993934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:22.995574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:23.022327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:23.024023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 352/705] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:23.032403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:23.175247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db242e1-5ce0-45a9-9a91-c3eff1f07194 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:23.211270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:23.212288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.212809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.213294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.214250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:23.214761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:23.216949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:23.229631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 354/706] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:23.237881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:23.349778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a500d-743a-4b8e-8676-7cb19ae9e52b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:23.404117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:23.404929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.405211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.405490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.415067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:23.416530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:23.433743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-1f555d9a-48fc-4727-98a8-fa9daa6cb076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:23.436067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 353/707] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:23.441870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:23.463406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafc36-fcf6-4afa-a218-f7f2b73ff6d2 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.463702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafc36-fcf6-4afa-a218-f7f2b73ff6d2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.463902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafc36-fcf6-4afa-a218-f7f2b73ff6d2 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.465963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 354/708] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:23.470986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.471269 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.471545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.489879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:23.491367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:23.614844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c87b-11df-47dc-b7b1-874a82884e34 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:23.616207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 355/709] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 14:38:23.656861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:23.657771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.658237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.658655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.659566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:23.660012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:23.661597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:23.665190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:23.692051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 355/710] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:23.697735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:23.850307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93689d4e-0b89-42c4-aa57-dc0e44716b7e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:23.851935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780b2de-3d7a-4228-8cf4-4b71b898adc7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:23.890353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:23.891020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.891306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.891580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.892406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=54185e0e2c5549f3b397a8009ae27713) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:23.892720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:23.895191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:23.903856 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 356/711] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:23 2022] GET /identity/v3/role_assignments?user.id=54185e0e2c5549f3b397a8009ae27713&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:23.924779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:23.925617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:23.925925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:23.926208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:23.942373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:23.943892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:23.973324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ea60de28-edbd-4dda-ab06-64817e11a88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:23.974633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 356/712] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:23.980820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:24.095933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff98c-f931-4fc0-9c58-d3a3bb144962 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:24.137975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:24.138566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.138855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.139132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.139858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:24.140166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:24.141550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:24.154596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 357/713] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:24.160606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357e4a2-c566-4e5a-a7f3-9906fce633e3 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.160894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357e4a2-c566-4e5a-a7f3-9906fce633e3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.161171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357e4a2-c566-4e5a-a7f3-9906fce633e3 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.162979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 357/714] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:24.163915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:24.170530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.170819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.171102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.207457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:24.208686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:24.271572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7bf5d-06aa-47ba-ad01-82438fbb8c01 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:24.307998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 358/715] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:24.314587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:24.315389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.315589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.315836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.316551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:24.318018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:24.330829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:24.361057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 358/716] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:38:24 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:24.444931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a685e-45d1-4485-a83c-58b18a65cd0d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:24.482039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:24.482860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.483180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.483405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.484075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:24.485498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:24.499368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 14:38:24.500944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 359/717] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:24 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:24.506495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:24.620440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e20b2-3d98-47b9-b46f-d0c950141417 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:24.661796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:24.662506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.662786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.663062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.663768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] RBAC: Adding query filter params (name=network) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:24.664075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:24.665437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dff69-3126-4c82-ab82-790fab39c724 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:24.670788 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 359/718] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:24.676128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:24.778980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686a994-05f3-42e0-9b94-2e28f1e599e4 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:24.814343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:24.815018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:24.815361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:24.815642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:24.816403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] RBAC: Adding query filter params (type=network) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:24.816717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:24.818131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711967-2183-4b5c-9dee-d1d657cf0e82 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:24.824358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 360/719] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:25.573969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee8105-6d7d-40a4-b7ec-27d6c26e6f13 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:25.574497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee8105-6d7d-40a4-b7ec-27d6c26e6f13 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:25.574497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee8105-6d7d-40a4-b7ec-27d6c26e6f13 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:25.577078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 360/720] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:25.582600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:25.583035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:25.583214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:25.600091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:25.601259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:25.670042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 361/721] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:25.690699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee8105-6d7d-40a4-b7ec-27d6c26e6f13 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:25.815859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee8105-6d7d-40a4-b7ec-27d6c26e6f13 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:25.857884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53865486-d47d-44b5-ba3c-bc26a6cd4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:25.858626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53865486-d47d-44b5-ba3c-bc26a6cd4c9f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:25.858914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53865486-d47d-44b5-ba3c-bc26a6cd4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:25.859184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53865486-d47d-44b5-ba3c-bc26a6cd4c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:25.878729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53865486-d47d-44b5-ba3c-bc26a6cd4c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:25.886003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-53865486-d47d-44b5-ba3c-bc26a6cd4c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:38:25.887544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 361/722] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:25.893305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:26.012304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5986c-2366-4261-a150-c083ef5bd943 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.013142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5986c-2366-4261-a150-c083ef5bd943 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.013400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5986c-2366-4261-a150-c083ef5bd943 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.015559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 362/723] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:26.022097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.022386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.022672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.035364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9141cb6-d5f5-4309-a306-9e0170605aac None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:26.062918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:26.064133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:26.071845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:26.072711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.073143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.073591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.074519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:26.075544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:26.077801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:26.087478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 362/724] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:26.095064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:26.181210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 363/725] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:26.222912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:26.227043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2316e6-c22d-4e34-bd16-8ccab9198b25 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:26.269895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:26.270714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.270994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.271272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.291307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:26.292791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:26.320297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:26.321759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 363/726] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:26.334402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:26.444568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b417e-c4f4-4659-a9b0-11d15211d042 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:26.472923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cabc3c-1afd-4ed2-bb11-f6788b15370f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:26.488779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:26.489446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.489724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.490026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.490740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:26.492162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:26.517564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 364/727] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:38:26 2022] POST /identity/v3/services => generated 251 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:26.518563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:26.519324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.519598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.519864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.520638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:26.520982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:26.522430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:26.540418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 364/728] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:26.541964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:26.708878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7d35-310b-4521-acbb-9b6f82284843 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:26.757501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:26.758499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.758783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.759055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.770572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:26.772035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:26.787404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-5e32742b-8fdf-4de5-af47-3ba4a924d2a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 14:38:26.788969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 365/729] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:26.794862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:26.897722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1089-fdf5-40aa-958d-ff9906be2490 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:26.906006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d9e3-e91a-4442-9a08-be9b86f1c6d4 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.906623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d9e3-e91a-4442-9a08-be9b86f1c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.907117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d9e3-e91a-4442-9a08-be9b86f1c6d4 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.909340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 366/730] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:26.914778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.915635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.916126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.933033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:26.933735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:26.934083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:26.937722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:26.937722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:26.937722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:26.937722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:26.943859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:26.945607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:26.964498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 365/731] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Mar 8 14:38:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:26.965725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.033011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 367/732] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:27.073287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.111587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc304-d8a8-4512-aa85-6e44558d1027 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.177570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.178246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.178521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.178792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.259512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa34f5-e22b-489e-962d-6df15630d9f8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.274786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.276258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.307533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.308727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.309847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.310854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.328281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:27.345413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:38:27.347255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 368/733] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:27.352535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.380290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 366/734] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:26 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 14:38:27.381685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.466089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a04d2e-ce46-41b1-ab69-2d3eafda3a69 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.483739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc6128-3c74-427a-8e29-d25ba66c0898 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.509328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.510434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.510944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.511420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.512391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:27.512916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.514791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.523835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 369/735] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:27.526582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ea681-3428-4539-bda7-76272681e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.527625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ea681-3428-4539-bda7-76272681e100 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.528814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ea681-3428-4539-bda7-76272681e100 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.529973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.531244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ea681-3428-4539-bda7-76272681e100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.545705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ea681-3428-4539-bda7-76272681e100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.547993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ea681-3428-4539-bda7-76272681e100 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.567621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-155ea681-3428-4539-bda7-76272681e100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:27.569432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 367/736] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:27.574461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ea681-3428-4539-bda7-76272681e100 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.677450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5393e4-df66-431d-85e3-5b30e095494a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.682754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ea681-3428-4539-bda7-76272681e100 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.712556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.714281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.714878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.715396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.717249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.718553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.718926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.719287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.720092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:27.720490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.721992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8097508-6802-4d33-89b8-06ce1ee6d254 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.728482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.730207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.738374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 368/737] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:27.739768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04715813-b77f-44dd-a2a7-58f5bc70594d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.740057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04715813-b77f-44dd-a2a7-58f5bc70594d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.740332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04715813-b77f-44dd-a2a7-58f5bc70594d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.742482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 369/738] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:27.743443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04715813-b77f-44dd-a2a7-58f5bc70594d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.749494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2f6a1ccb-2534-41fa-8521-2103f1f106fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:27.751086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 370/739] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:27.752367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.752726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.753081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.770731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:27.772325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:27.840128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 371/740] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:27.842245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.847455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04715813-b77f-44dd-a2a7-58f5bc70594d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.880437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.881234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.881572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.882076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.890035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.891762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.906621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:27.908069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 370/741] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:27.908942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:27.946915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd7ca7-bc53-4e3a-9fe1-6ff52894080e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:27.980399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:27.981094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.981534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.982050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.982766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:27.983072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:27.984491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7e55a-4774-4614-81d1-ef6fc734c4ce None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:27.995336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 372/742] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:27.996855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58ed9-9419-4493-9afe-452c39d4ee90 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:27.997312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58ed9-9419-4493-9afe-452c39d4ee90 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:27.997592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58ed9-9419-4493-9afe-452c39d4ee90 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:27.999469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 373/743] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:27.999918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f58ed9-9419-4493-9afe-452c39d4ee90 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.023235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759a877-4720-4411-ab86-8f6e4dbf65a6 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.061029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.061828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.062129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.062395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.072417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:28.080526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:28.081949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 371/744] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:28.082505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.103828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f58ed9-9419-4493-9afe-452c39d4ee90 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.137803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.138512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.138806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.139067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.139867 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:28.140172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.141667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5fb88-b9d9-4adf-ac1c-aebf3080afbd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.154020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 374/745] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:28.155403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.155688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.155964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.175160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:28.176357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:28.187351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5200-5793-4307-89ac-5059078546dc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.220361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.221155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.221431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.221708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.229159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.230629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.252176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 375/746] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 14:38:28.252176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.252445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:38:28.252445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 372/747] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:28.252445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.346680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62718393-f434-46a5-90fc-7da434e02434 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.354414 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4194-c0f0-48cb-ba37-2db026f11a9f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.383999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.384676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.384937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.385215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.386050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=e5b56d7d7db04439a40f4a02b9ad8135) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:28.386364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.387915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.388175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.388579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.388857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.389133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.389879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:28.390199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.391544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.401692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 373/748] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/role_assignments?user.id=e5b56d7d7db04439a40f4a02b9ad8135&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:28.401692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.412230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 376/749] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:28.413203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.507892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec28ef-598e-4dc0-b75a-32a441fde703 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.544090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.544833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.545158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.545455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.546024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae3542-8a23-4dd3-85ad-d59421790a48 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.546333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:28.546639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.548502 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.576809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 374/750] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:28.576809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.602000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.602789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.602896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.603134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.603851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.605258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.629885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 377/751] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:38:28 2022] POST /identity/v3/services => generated 240 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:28.629885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.756165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f247f-cbe4-4a20-947d-8b6a7b435ba8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.786296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a9f7a-ee22-49a5-8136-25138fc9541d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:28.798768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.799731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.800130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.800497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.814027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.815824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.835631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:28.837379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 378/752] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:28.844132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.859022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:28.860374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:28.861521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:28.861983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:28.874716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:28.876189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:28.895408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:28.896973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 375/753] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:28.903578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:28.976008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112185-a3b7-40fc-acff-df21fd66548e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.022788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd888f86-ae82-46f8-a2d5-35617554735d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.034595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.035278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.035560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.035836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.036556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:29.036861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.038276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.056675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 379/754] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:29.061982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.062351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.062668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.062949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.063331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.064068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:29.064370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.065780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.080333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 376/755] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:29.088005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.223972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391a336-2d42-4687-88c3-a1916dcbc590 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.281993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc743-3297-42b8-870a-c475b1e0452b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.295379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.296130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.296410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.296683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.308611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.311358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.331134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:29.333148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 380/756] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:29.338654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.353608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.354910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.355394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.356894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.373800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.375597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.398470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 14:38:29.407589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 377/757] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:38:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:29.415226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.480287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589e4dd-8330-4c7f-889e-60d26d0340fd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.514991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.516049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.516537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.517046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.518062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:29.518609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.520237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bafdd5-010f-4285-9cba-e5f282e56280 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.532871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7eb3b-a7f7-4e03-8041-ec2cbe2eae16 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.533450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 381/758] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:29.535015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b74d-8050-4403-bd16-26e382af9a23 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.535533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b74d-8050-4403-bd16-26e382af9a23 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.536012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b74d-8050-4403-bd16-26e382af9a23 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.538121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 382/759] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:29.539334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7b74d-8050-4403-bd16-26e382af9a23 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.580913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.581654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.581975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.582251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.583144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:29.583457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.584908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f54d6-d1c7-4350-ae05-0a62ff4c357d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.613435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 378/760] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Mar 8 14:38:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:29.613435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.613435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.613435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.628861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:29.630096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:29.654248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7b74d-8050-4403-bd16-26e382af9a23 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.692160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.693579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.694102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.694600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/54185e0e2c5549f3b397a8009ae27713/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.696870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=54185e0e2c5549f3b397a8009ae27713, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.698577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:29.702198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 379/761] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:29.703062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.727879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 383/762] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:29 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/54185e0e2c5549f3b397a8009ae27713/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:38:29.729036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:29.882108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee49c11-8a72-4952-8bd7-07e23941c086 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.908816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a199e7-ae24-41a6-b994-a61b481e79f7 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:29.915287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:29.915947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:29.916234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:29.916507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:29.989453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:29.990969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.017693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.018539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.018976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.019263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.019922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.021894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.036427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 14:38:30.038663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 384/763] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Mar 8 14:38:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:30.045125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.122796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 380/764] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:38:30.134759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.179115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc94ec1-3821-4afe-abb4-772c12ddf8e8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.217771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.218872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.219230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.219580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.220509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:30.221008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.222499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.228026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 385/765] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:30.234930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.312891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68027843-54a8-48d5-87fe-6d40a7e31a23 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.348658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.349706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.350169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.350590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.361778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.363581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.382542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:30.384377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 381/766] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:30.389603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.413889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d55d06-ecfb-40c6-997a-7e94d645e513 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.445733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.446434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.446714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.446986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.447828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:30.448153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.449891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.456208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 386/767] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:30.461671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.585476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26666a8-ce0c-45c9-8a35-e7d818f889b3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.601882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673aa47d-d576-4eb8-9eb5-9ff88c3be346 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.634178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.634840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.635118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.635389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.636168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] RBAC: Adding query filter params (interface=public, service_id=db7bd53dcf98417ca62f884252cd3c63, region_id=RegionOne) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:30.636472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.637945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.646299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 387/768] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/endpoints?service_id=db7bd53dcf98417ca62f884252cd3c63&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:30.651841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.659991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.660661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.660938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.661206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.661951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:30.662256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.668789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.687191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 382/769] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:30.694522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:30.849520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f4ecb-021d-4fce-8fa9-e3a5d49c6ae5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.886725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043184db-e847-4926-9e93-220933affa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.888734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043184db-e847-4926-9e93-220933affa73 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.889218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043184db-e847-4926-9e93-220933affa73 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.889821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043184db-e847-4926-9e93-220933affa73 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.891089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043184db-e847-4926-9e93-220933affa73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.892650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043184db-e847-4926-9e93-220933affa73 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:30.898702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 388/770] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:30.918212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ed415-2cab-445b-a5ee-3cd81f54fb0e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:30.974770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:30.975605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:30.975883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:30.976154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:30.984572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:30.986048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.004139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-cb9ddc3c-3c2b-4c38-b360-061957a3c702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:31.005803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 383/771] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:31.011693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043184db-e847-4926-9e93-220933affa73 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.029932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f827621-1db9-4923-b626-96db4f7d239e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.029932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f827621-1db9-4923-b626-96db4f7d239e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.029932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f827621-1db9-4923-b626-96db4f7d239e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.029932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 384/772] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:31.035816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060b25-e9f6-43b6-8061-503218643948 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.036190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060b25-e9f6-43b6-8061-503218643948 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.036533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060b25-e9f6-43b6-8061-503218643948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.057357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-45060b25-e9f6-43b6-8061-503218643948 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:31.058959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-45060b25-e9f6-43b6-8061-503218643948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:31.137786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 385/773] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:31.173329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060b25-e9f6-43b6-8061-503218643948 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.191994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043184db-e847-4926-9e93-220933affa73 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.234921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.235962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.236445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.236918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.238433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:31.239529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:31.243689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.262622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 389/774] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:31.269545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.295656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060b25-e9f6-43b6-8061-503218643948 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.341734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.343374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.344061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.344533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.358485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:31.367857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:38:31.370022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 386/775] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:31.378791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.381734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18102dae-0817-4bf6-9e7f-278fa5a7728f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.417293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.418071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.419101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.419518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.420437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=35aafe4494a046cca9096751b630db04) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:31.420814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:31.422344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0bc71-583d-406f-9459-bbfbbabc69c9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.428682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 390/776] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/role_assignments?user.id=35aafe4494a046cca9096751b630db04&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:31.429725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ef03-ea39-4727-8fdd-d953246d501e None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.434031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ef03-ea39-4727-8fdd-d953246d501e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.434031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9ef03-ea39-4727-8fdd-d953246d501e None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.434031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 391/777] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:31.438768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.439105 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.439351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.462213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:31.462213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:31.522622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8c2b6-59f7-44e3-bff5-0f48c77f01fe None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.551541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 392/778] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:31.561005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.561973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.562457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.562933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.563873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:31.564383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:31.566002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.575807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 387/779] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:31.583328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.593944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.693644 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884682-bfe6-49cd-a2c7-50ab120cc4ac None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.735612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.735822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.736055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.738261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.748954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:31.750729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.771910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:31.773444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 393/780] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:31.779541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.792258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ce3e-6a91-4458-8592-b85d32deab9d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.871977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.873348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.873834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.874355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] PATH_INFO: `/v3/services/network` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.875206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:31.876897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.900259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916bfa6-b197-43f1-8396-cf41cf278d12 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:31.908354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 14:38:31.910253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 388/781] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/services/network => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:31.928360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:31.948026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:31.948668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:31.948962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:31.949190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:31.950697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:31.951259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:31.952638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:31.986700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 394/782] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:31.991894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.075635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2ca1-0a64-4d56-a594-6ea2ce3cf67f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.112965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.114029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.116685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.117167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.118117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:32.118625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.120199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.133895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 389/783] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:32.135033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.184462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb513fb1-820a-4eec-a6c1-fa2244ba607d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.256695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.257497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.257776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.258070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.269486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.270951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.282414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd4fdd-43b7-4eaf-8b09-716aa538f1d4 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.300873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 14:38:32.303358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 395/784] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:32.307860 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.322740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.323760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.324251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.325254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.326452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] RBAC: Adding query filter params (type=network) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:32.326956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.328534 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.337911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 390/785] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:32.345748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.448127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b32f1-634c-424f-a703-85c73487e09b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.486349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.487262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.487690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.488132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.489074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] RBAC: Adding query filter params (interface=public, service_id=278e711bc5de448e8e46cf0df1ea2bcb, region_id=RegionOne) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:32.489533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.491081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.499945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 391/786] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/endpoints?service_id=278e711bc5de448e8e46cf0df1ea2bcb&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:32.506875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.526612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79adbb-796b-4aba-93a1-0eff3693bcb6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.564707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.565387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.565666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.565982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.567319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:32.567633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.569624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb69a-b015-4178-8cfa-0b4ebbd0d9c0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.593952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 396/787] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:32.595384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2657c5-4635-47ef-927c-3580ae74b758 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.595677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2657c5-4635-47ef-927c-3580ae74b758 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.595961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2657c5-4635-47ef-927c-3580ae74b758 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.597675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 397/788] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:32.598414 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2657c5-4635-47ef-927c-3580ae74b758 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.675768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5fdbe-23c8-4c67-9957-17254f0418fb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.714828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7225e-5349-4262-9d6a-9febae56b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.716952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7225e-5349-4262-9d6a-9febae56b80d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.717623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7225e-5349-4262-9d6a-9febae56b80d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.718428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7225e-5349-4262-9d6a-9febae56b80d None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.719616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7225e-5349-4262-9d6a-9febae56b80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.721966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7225e-5349-4262-9d6a-9febae56b80d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.725144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2657c5-4635-47ef-927c-3580ae74b758 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:32.735821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 392/789] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:32.737228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.737520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.737825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.755759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:32.757042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:32.818716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:32.819550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:32.819832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:32.820105 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:32.833982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 393/790] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:32.847214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:32.848706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:32.853242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.881926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:32.889964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 398/791] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:32.899385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:32.963545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e07665-f01f-4041-8e1b-48bfee5f8866 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.001782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.002648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.002925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.003196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.014237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:33.022167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:38:33.028771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 394/792] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:33.030011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.038398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ae46-5b32-4bf3-a0cb-3804f31722a9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.072148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.072818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.073100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.073377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.074119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:33.074426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.076969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.089663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 399/793] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:33.098053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.131375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fd9c-344f-4dc3-8ab9-01565c730914 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.165181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.165844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.166158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.166425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.167156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:33.167454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.168874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.181753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 395/794] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:33.182970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.198842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44d6f-87f6-45cc-b00e-9a18d5406c42 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.233426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.234317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.234600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.234875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.243934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.246797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.263526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:33.265080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 400/795] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:33.274861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.317960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73643a47-6734-4b5a-bd91-c7e5277dbaf2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.395531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.396353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.396640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.396904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.420174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.421109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b0a7a-e8f7-4617-9ce0-7b237f7f7ca9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.421645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.451623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:33.456518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.457186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.457467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.458020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.458805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:33.459117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.460539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.462007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 396/796] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:33.462895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.473249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 401/797] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:33.479342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.631647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a844-8a9e-46a0-8bf8-2994cda99445 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.670600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef20ee-ce36-4eb0-a1ce-4f14c82da8c5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.672508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.673183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.673464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.673744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.674482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:33.674791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.676188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.696808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 397/798] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:33.704369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:33.727725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.728940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.730137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.730659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/e5b56d7d7db04439a40f4a02b9ad8135/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.736489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=e5b56d7d7db04439a40f4a02b9ad8135, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.738193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.764338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 402/799] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:33 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/e5b56d7d7db04439a40f4a02b9ad8135/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:38:33.852455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09be33-a33c-4ef2-8491-a656e24c1968 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:33.900123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:33.901320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:33.901799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:33.902312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:33.911784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:33.913261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:33.934738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d3dee178-1cfe-4299-b70b-3eeb2e1c63d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:38:33.936245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 398/800] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:33.941840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.027350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54319d-dfb3-4209-ba43-32478cee7c3b None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.028119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54319d-dfb3-4209-ba43-32478cee7c3b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.028119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54319d-dfb3-4209-ba43-32478cee7c3b None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.029838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 399/801] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:34.036409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c19906-1268-4db0-a583-83518760ff49 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.036654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c19906-1268-4db0-a583-83518760ff49 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.036897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c19906-1268-4db0-a583-83518760ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.057286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-29c19906-1268-4db0-a583-83518760ff49 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:34.058922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-29c19906-1268-4db0-a583-83518760ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:34.086521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a587de-2eac-44f5-a736-5bdac53471e8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.120706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.121932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.122308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.122727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.123562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:34.123868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:34.125303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:34.143404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 403/802] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:38:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:34.148787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.185199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 400/803] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:34.186522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff078686-1157-476b-81c3-d73c38ceaeac None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.186807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff078686-1157-476b-81c3-d73c38ceaeac None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.187083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff078686-1157-476b-81c3-d73c38ceaeac None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.189022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 401/804] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:34.194173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.194457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.194729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.213311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:34.214528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:34.274818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158a2c-f81c-4823-a92b-c0161de483b8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.303257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 402/805] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:34.304920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.314709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.315772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.316053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.316328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.400071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:34.401818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:34.417354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3b7f-e138-440e-acbe-cd5b04ae0bcc None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.454613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.455382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.455671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.455945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.456974 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:34.458743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:34.474676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 14:38:34.481573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 403/806] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:34.481573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.521166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 404/807] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:38:34.522349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.592223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7f834-b684-459e-b8b2-3798f748602f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.628232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.629040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.629320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.629592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.643035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:34.643456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f591f-23dc-4bd4-8fc1-8c426697914b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.651727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:34.654062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 404/808] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:34.654851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.692221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.692895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.693180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.693463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.694194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:34.694503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:34.696046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:34.706081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 405/809] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:34.707195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.784613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f376d-05e1-45bd-99b1-0faf6ab1b6a9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.808434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b3244-d5fd-4bc4-a062-eef90f6d2d69 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.826416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.827753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.828185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.828603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.843591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:34.843990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:34.844753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:34.845202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:34.845570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:34.845950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:34.846542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:34.846943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:34.848527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:34.861827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 406/810] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:34.861827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.869556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:34.875149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 405/811] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:34.875149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:34.978018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e93b5-6b6f-4774-837e-bf9a5d3563b3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:34.995626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6007e8e-9f9b-4f8c-a8c6-354bdc5d9344 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.014610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.015779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.016260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.016731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.027600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.031127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.034169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.034849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.035130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.035404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.036118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:35.036423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.037772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.047136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 407/812] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:35.048330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.059134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:35.065990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 406/813] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:35.066896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.157371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014d28-5812-4e64-8f57-5ce31945000a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.190802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c96627-f332-4519-9827-51e6eb7dd149 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.191823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.192556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.192909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.193256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.194605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:35.194605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.195857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.213892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 408/814] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:35.214981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.232168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.233333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.233802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.234363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.235547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.237070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.270012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 407/815] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:38:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:35.271171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.376277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839b14-f954-4dff-9c59-e204ad38d7ab None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.426966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.428222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.428653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.429258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.430165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:35.430614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.432283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.447446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 409/816] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:35.450449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e179c01-e5e2-4361-a57c-71af0926e2b1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.453789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.523257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.524309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.525450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.526577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.540358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.544012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.563034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:35.564819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 408/817] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:35.570590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.622046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682df283-964c-418c-9e38-3bda63a2321c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.665167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.666049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.666325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.666605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.679550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.681278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.682659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec245-fe42-4175-8b0e-b202c1c7fe06 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.706160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a2271600-6757-4e67-a6b3-c48cca1f4f66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 14:38:35.708392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 410/818] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:35.714372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5864f9-50ab-4d81-a274-abd346dca66c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.714838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5864f9-50ab-4d81-a274-abd346dca66c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.714838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5864f9-50ab-4d81-a274-abd346dca66c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.717198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 411/819] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:35.718446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5864f9-50ab-4d81-a274-abd346dca66c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.727330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.727991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.728270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.728544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.729324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:35.729628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.731240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264528-841c-4a4b-89f6-6002c45de07f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.743452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 409/820] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:35.749881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.749881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.749881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.768377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:35.769559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:35.842702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 410/821] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:35.848638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.874624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5864f9-50ab-4d81-a274-abd346dca66c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:35.921452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:35.922648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:35.922932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:35.923204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:35.924030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:35.924341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:35.925787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:35.953829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 412/822] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:35.953829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:35.993495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27e85-0ead-437a-a8d9-8ded1fe8eb8c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.037776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.039480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.040113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.040858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.041892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=54185e0e2c5549f3b397a8009ae27713) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:36.042415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.045013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.059360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 411/823] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/role_assignments?user.id=54185e0e2c5549f3b397a8009ae27713&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:36.059360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.064083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16865e2-7507-4c94-a634-6377477c4488 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.127708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.128452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.128731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.129002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] PATH_INFO: `/v3/services/network` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.129657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.131083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.153920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 14:38:36.157184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 413/824] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:35 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:36.166853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.266633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47bd7f-489b-4f4b-9dae-d720b9493754 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.315535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.316374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.316682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.316954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.328726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.330215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.341133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32495-5d74-46f2-b67c-aac90440eaf5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.349331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:36.350871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 412/825] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:36.356403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.384845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.386667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.388312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.389002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.390297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] RBAC: Adding query filter params (name=network) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:36.391048 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.392801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42110803-c095-4c18-8644-ce4ae796e551 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.399374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 414/826] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:36.400941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c22e-9a0e-4e23-be36-beff4ebf5e0d None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.401226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c22e-9a0e-4e23-be36-beff4ebf5e0d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.401497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c22e-9a0e-4e23-be36-beff4ebf5e0d None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.403585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 415/827] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:36.404514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11c22e-9a0e-4e23-be36-beff4ebf5e0d None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.477079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9dd1a-7ace-4aec-940b-fe4517a5fc61 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.514458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11c22e-9a0e-4e23-be36-beff4ebf5e0d None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.521059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.521734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.522150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.522428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.523144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:36.523448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.524829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acceef-42da-4e72-be9a-e10074cc48d8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.537080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 413/828] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:36.542753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.543047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.543378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.548880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.549540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.549818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.550120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.550874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] RBAC: Adding query filter params (type=network) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:36.551207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.552622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.558061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 416/829] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:36.559475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.565485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:36.567852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:36.649609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 414/830] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:36.650442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.685108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665aa87-3d0c-4fa8-a966-6cf3e3d4493a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.720068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.720915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.721195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.721483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.728099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.729581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.742842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:36.744301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 417/831] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:36.745073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.779285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ff3ef-5bbd-4ca9-9b5b-df9e9252f872 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.819085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.819745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.820026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.820462 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:36.821656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:36.823335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:36.849950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 415/832] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:38:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:36.851008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:36.883940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdc652-bb13-46e5-969a-996e133a734c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:36.975653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:36.976475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:36.976752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:36.977024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.004383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:37.017493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:38:37.019152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 418/833] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:37.029322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:37.069244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f109304-01cf-49a8-a46a-8fcf3d16a691 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:37.108541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:37.109223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:37.109510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:37.109787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.110609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:37.110918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:37.112370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:37.127379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 416/834] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:37.136728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:37.153195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841d8f-7a20-426c-a507-6309c7a41a06 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:37.205283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:37.205905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:37.206187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:37.206465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.207216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:37.207523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:37.208890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:37.218748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 419/835] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:37.224426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:37.251557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996a14-1eda-4e7d-9f81-7d68cbed3340 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:37.287922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:37.289094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:37.289533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:37.290055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/35aafe4494a046cca9096751b630db04/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.305584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=35aafe4494a046cca9096751b630db04, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:37.307454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:37.323601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 417/836] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:37 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/35aafe4494a046cca9096751b630db04/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:38:37.334219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca35c10-1f8f-41c2-a7cb-fe859499e481 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:37.374227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:37.375504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:37.376002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:37.376511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.389349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:37.391836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:37.411830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:37.414071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 420/837] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:37.424120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:37.551056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc97c79-8299-4936-809e-5ae16d741ed2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:37.594107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:37.596335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:37.596335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:37.596335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.596335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:37.596335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:37.598331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:37.610109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 418/838] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:37.615596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:37.739757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700efcc-8ff5-4523-ab82-daf5821ae804 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:37.774091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:37.775058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:37.775343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:37.775621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:37.784096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:37.785528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:37.802653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-d48c83d5-6058-4b21-8b47-8976c41ede08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 14:38:37.809445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 421/839] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:38:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:37.810518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.000595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05a4b9-3e02-4e9c-a67d-ea7b57298d2b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.001188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b193-0acc-4e2a-946e-13f2801bf8b6 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.001483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b193-0acc-4e2a-946e-13f2801bf8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.001764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b193-0acc-4e2a-946e-13f2801bf8b6 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.003542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 422/840] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:38.013672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.013995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.014275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.042781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.043829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.044308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.044771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.045792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:38.046321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.047938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.048319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:38.049539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:38.068389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 419/841] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Mar 8 14:38:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:38.078528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.136301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 423/842] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:38.158922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.235922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ba3e7-4488-4191-9131-8c3c952d9918 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.261681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e08494-3cc4-41e3-bf6b-155093562e77 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.279303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.280687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.281158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.281624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.297598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.298524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.298882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.299251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.299979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.301439 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.313170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 14:38:38.317908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 424/843] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:38.320542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.362463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.364165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.422758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379a32-bb30-473e-8e2f-0fa1c142c55e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.459567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.460153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.460540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.460910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.461720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:38.462153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.463619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.473887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 425/844] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:38.474354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 420/845] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:38:38.475380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.476162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.576315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcb38c-f442-4c93-9204-d082bf479c82 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.577029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde737-0eac-4f03-a305-796cbb1a2662 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.612957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79602558-ee49-413e-928c-a72daf616166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.613465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.613893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79602558-ee49-413e-928c-a72daf616166 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.614295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79602558-ee49-413e-928c-a72daf616166 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.614690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79602558-ee49-413e-928c-a72daf616166 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.614932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.615361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.615676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79602558-ee49-413e-928c-a72daf616166 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:38.615932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.616167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79602558-ee49-413e-928c-a72daf616166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.617634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79602558-ee49-413e-928c-a72daf616166 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.627973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.629812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.629965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 426/846] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:38.649485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-94d743dd-4023-4d26-b503-0101d9b37ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:38.651503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 421/847] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:38.658251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79602558-ee49-413e-928c-a72daf616166 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.772606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79602558-ee49-413e-928c-a72daf616166 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:38.790063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925f76-6728-4dff-a1ac-0ae065ecbc5d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.790403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925f76-6728-4dff-a1ac-0ae065ecbc5d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.790626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925f76-6728-4dff-a1ac-0ae065ecbc5d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.792546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 422/848] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:38.799458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.800032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.800310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.818668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:38.819710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:38.820204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:38.820749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:38.821292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:38.821915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:38.822438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:38.822540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:38.826941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:38.844095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 427/849] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:38.849468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.899307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 423/850] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:38.922179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:38.965360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244a129-6cdc-4463-9538-8821e9bc744d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:39.006741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:39.007560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.008332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.008616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.017464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:39.019354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:39.034984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:39.041973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 428/851] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:39.043913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:39.046116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87311d38-5f13-43d5-8493-0cc81277a230 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:39.082074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:39.083594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.084024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.084452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.085259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:39.086885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:39.099024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 14:38:39.100713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 424/852] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Mar 8 14:38:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:39.106686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:39.150539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e72041-f272-4726-95c3-5173d2d36ba4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:39.184510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:39.185203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.185487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.185780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.186566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:39.186877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:39.188327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:39.207057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 429/853] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:39.208274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:39.223705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c88b8-5ba1-4e43-a8af-a68bdca6f1d9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:39.258537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:39.259601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.260082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.260566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.262195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:39.263088 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:39.265202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:39.271863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 425/854] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:39.277091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:39.307774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35731-0c7d-40c8-8250-ed90931f94dd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:39.344157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:39.344998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.345485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.345927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.346955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=e5b56d7d7db04439a40f4a02b9ad8135) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:39.347267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:39.348772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c665c5-3bf3-4f78-babc-1f305ee47285 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:39.362026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 430/855] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:39 2022] GET /identity/v3/role_assignments?user.id=e5b56d7d7db04439a40f4a02b9ad8135&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:39.401590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f290ee-2260-4f3d-981b-0ad186d7eaf5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:39.440474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:39.441599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.442150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.442648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.443597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:39.444125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:39.445831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d14d6f-87a0-4d64-acb8-edd6c8f5612c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:39.452773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 426/856] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:39.819952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e770d-69ba-4250-a0af-65c093c9c499 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.820493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e770d-69ba-4250-a0af-65c093c9c499 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.820493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e770d-69ba-4250-a0af-65c093c9c499 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.822547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 431/857] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:39.829097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:39.829389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:39.829672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:39.847286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:39.848508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:39.915043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 427/858] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:39.940811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e770d-69ba-4250-a0af-65c093c9c499 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:40.045993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e770d-69ba-4250-a0af-65c093c9c499 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:40.080026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:40.080758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:40.081044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:40.081359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:40.091709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:40.098962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:38:40.100434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 432/859] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:38:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:40.106307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:40.204461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be3ab7-f317-422d-b7be-855db736e7f5 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:40.238845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:40.239881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:40.240384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:40.240865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:40.241822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:40.242364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:40.243941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:40.253457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 428/860] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:38:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:40.258828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:40.363690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1b7ec-3f9d-4bc9-a310-55c4bcfc7762 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:40.401321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:40.402144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:40.402457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:40.402776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:40.413719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:40.415177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:40.432302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:40.434362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 433/861] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:40.439672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:40.548209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2bfea-a7d8-4c29-9f17-d5ecce77e95d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:40.583975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:40.585045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:40.585565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:40.586079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:40.587033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:40.587553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:40.589218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:40.605051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 429/862] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:40.615077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:40.720142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3873cb0-b9fc-48d7-b746-786e1a2c447c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:40.761247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:40.762723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:40.763011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:40.763372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:40.771329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:40.772782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:40.788226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 14:38:40.789566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 434/863] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:38:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:40.796234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:40.902074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc8e5-e9bb-42c8-93c5-90f136f2a13b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:40.943797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:40.944487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:40.950999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:40.951313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:40.952190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:40.952508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:40.954001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f11511-659e-4daf-ab8a-a3df57b49974 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:40.973278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 430/864] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Mar 8 14:38:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:40.978823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:41.081935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301e0e-2ef0-4381-8868-f5df7239364b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:41.116303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:41.117378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.117951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.118431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.190374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:41.191741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:41.209414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2e4a5-6e01-49c0-88e2-6989009e5e8a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.209938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2e4a5-6e01-49c0-88e2-6989009e5e8a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.210039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2e4a5-6e01-49c0-88e2-6989009e5e8a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.212011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 431/865] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:41.218541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.218823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.219095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.237412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:41.238625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:41.292906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 435/866] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:38:41.302890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:41.318700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 432/867] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:41.342506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:41.410646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f0f1-51d9-46b6-9825-b7df63ff0def None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:41.441702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851d22-e305-4dff-a163-2ed4d72ad5eb None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:41.447743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:41.448900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.449462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.450892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.462731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:41.464620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:41.479264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:41.479944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.480226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.480504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.482085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:41.483445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:41.487779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:41.489714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 436/868] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:41.499126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:41.502027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 433/869] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:38:41 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:38:41.617409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb279063-dceb-48c8-a6af-a106d1fe4c57 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:41.664219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:41.665143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.665576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.666066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.667000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:41.667511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:41.669197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05bac-087e-4912-ba7e-d9f4dc7e53a2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:41.682423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 437/870] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:41.688870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:41.796446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0826f-88ce-479d-82b8-75abb8fa253a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:41.830925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:41.831734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.832015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.832289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.839269 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:41.841330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:41.856905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca445-b7e3-4831-b48c-8ee4dcb04d7c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.857201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca445-b7e3-4831-b48c-8ee4dcb04d7c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.857470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ca445-b7e3-4831-b48c-8ee4dcb04d7c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.858310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f4ac0eb7-a1eb-4d22-b0cc-a2422d579ab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:41.859530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 438/871] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:41.860284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 434/872] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:41.865446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca445-b7e3-4831-b48c-8ee4dcb04d7c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:41.866521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411548-a17f-4b22-81af-379c965cd23a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.867063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411548-a17f-4b22-81af-379c965cd23a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.867579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411548-a17f-4b22-81af-379c965cd23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.885655 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-3b411548-a17f-4b22-81af-379c965cd23a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:41.887368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3b411548-a17f-4b22-81af-379c965cd23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:41.964099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 435/873] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:41.966375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739679fb-6405-4eac-b868-e9dcb3a76699 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.966689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739679fb-6405-4eac-b868-e9dcb3a76699 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.966991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739679fb-6405-4eac-b868-e9dcb3a76699 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.969946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 436/874] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:41.974398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:41.974877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:41.975337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:41.991940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ca445-b7e3-4831-b48c-8ee4dcb04d7c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:41.994198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:41.995636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:42.025278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:42.025958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:42.026248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:42.026522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:42.027284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:42.028316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:42.029985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:42.041316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 439/875] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:42.042231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:42.074134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 437/876] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:42.074134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:42.160623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bcbfc-b89f-439d-8d45-e6915fdcc267 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:42.187174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b75d-7924-45b3-8db0-d0854415e935 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:42.193022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:42.193824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:42.194132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:42.194405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:42.195044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:42.196453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:42.207841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 14:38:42.208997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 440/877] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:42.209739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:42.230174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:42.232043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:42.232326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:42.232603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:42.233421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=35aafe4494a046cca9096751b630db04) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:42.233728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:42.235338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:42.241001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 438/878] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:42 2022] GET /identity/v3/role_assignments?user.id=35aafe4494a046cca9096751b630db04&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:42.242841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:42.328523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a8c5-bbd7-4f3b-a7ea-060a2c94d3ca None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:42.373925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63f078-a68f-4f24-9e74-7a667ea4384a None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:42.375190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:42.376017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:42.376393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:42.376768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:42.377630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:42.379230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:42.401941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 441/879] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:38:42 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:42.431374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:42.432067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:42.432355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:42.432858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:42.434300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:42.434742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:42.437542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276e63-fda6-4f1c-b6d0-e2490ca837ee None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:42.446720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 439/880] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:42.455005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:42.581806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e99f-80e6-4429-9532-76f92d61a4aa None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:42.616855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:42.617525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:42.617807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:42.618114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:42.618821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:42.619123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:42.620495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577cdb-deab-45ac-82ce-2a3a7fed3179 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:42.626232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 442/881] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:43.893319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b18bc-6aaa-4133-9312-fe63bbb35437 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:43.893833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b18bc-6aaa-4133-9312-fe63bbb35437 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:43.893930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b18bc-6aaa-4133-9312-fe63bbb35437 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:43.895875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 440/882] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:43.901236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:43.901643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:43.901808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:43.919710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:43.920894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:43.995758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 443/883] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:44.017803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b18bc-6aaa-4133-9312-fe63bbb35437 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:44.120917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b18bc-6aaa-4133-9312-fe63bbb35437 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:44.154772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:44.155503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.155783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.156058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.156705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:44.158118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:44.169453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 14:38:44.170961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 441/884] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:44.176824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:44.276592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5b5f7-d7fb-44c7-8a82-6caf012daf9b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:44.310806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:44.311850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.312359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.312826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.313723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:44.314257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:44.315812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:44.321071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 444/885] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:44.327106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:44.430659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2dbc4-ae1b-4f80-9e89-5dac12f3c88c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:44.464987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:44.465687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.466000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.466279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.467002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:44.467309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:44.468736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:44.474782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 442/886] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:44.481236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:44.580987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5060-c2de-4afc-a94f-072c46737814 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:44.615787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:44.616444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.616724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.616997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.617781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] RBAC: Adding query filter params (interface=public, service_id=4395ca4e7e7748e2955103cbc6a99b9d, region_id=RegionOne) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:44.618121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:44.619482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23646-06cb-4d1b-b2f4-9b530b0c122b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:44.625391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 445/887] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/endpoints?service_id=4395ca4e7e7748e2955103cbc6a99b9d&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:44.630797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:44.734932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b832c2-fa1a-44f4-adc1-70440426b9be None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:44.747483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a8b4-3e31-4701-865f-3be45f27e1ee None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.747795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a8b4-3e31-4701-865f-3be45f27e1ee None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.748339 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a8b4-3e31-4701-865f-3be45f27e1ee None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.750939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 446/888] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:44.756255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.756541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.756819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.774845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f7713-6b9b-4ef9-bf58-e2a87a00c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:44.775511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f7713-6b9b-4ef9-bf58-e2a87a00c3fe None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.775791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f7713-6b9b-4ef9-bf58-e2a87a00c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.776064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f7713-6b9b-4ef9-bf58-e2a87a00c3fe None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.776308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:44.776741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f7713-6b9b-4ef9-bf58-e2a87a00c3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:44.778089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:44.778778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f7713-6b9b-4ef9-bf58-e2a87a00c3fe None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:44.786055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 443/889] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:38:44.854495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684baf01-245f-41fa-ae4f-b16b891f38cb None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.854925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684baf01-245f-41fa-ae4f-b16b891f38cb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.855192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684baf01-245f-41fa-ae4f-b16b891f38cb None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.857213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 444/890] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:44.857685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 447/891] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:44.862417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:44.862967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:44.863448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:44.882214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:44.883046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:44.884478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:44.957006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 445/892] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:44.987694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.006794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274a85-1a29-4cb9-a03f-f1ef515fe912 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.060008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c709-9869-4503-b219-499d3cd3e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.061368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c709-9869-4503-b219-499d3cd3e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.062192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c709-9869-4503-b219-499d3cd3e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.062935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c709-9869-4503-b219-499d3cd3e0c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.077607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16c709-9869-4503-b219-499d3cd3e0c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:45.085296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2e16c709-9869-4503-b219-499d3cd3e0c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 14:38:45.086669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 448/893] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:45.087730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846017f-bfca-4d2a-9fda-c074756c528c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.088111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846017f-bfca-4d2a-9fda-c074756c528c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.088391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846017f-bfca-4d2a-9fda-c074756c528c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.090922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 449/894] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:45.094009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846017f-bfca-4d2a-9fda-c074756c528c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.105055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a03ec-0020-4c93-9cd8-73c18d642bb7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.140598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.141412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.141690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.141994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.142633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.144014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.156229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2612608a-4146-40f5-9639-550cda625dd5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 14:38:45.161906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 446/895] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Mar 8 14:38:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:45.161906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.161906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.161906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.177574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:45.179000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:45.197284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846017f-bfca-4d2a-9fda-c074756c528c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.231568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.232242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.232525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.232802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.233538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:45.233848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.235238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.247859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 450/896] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:45.247859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.250093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 447/897] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:45.250880 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.352416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db5db-e91c-4d42-9c9f-5b0ebd25ee0f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.361745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199606-cbd4-4643-a5da-44edd1a239aa None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.385902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.386580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.386886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.387165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.387863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:45.388170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.389524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.393976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 451/898] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:45.394730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.400798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.401893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.402765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.403612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.413934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.415379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.432550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:45.434099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 448/899] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:45.438639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.496287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c981c6-776c-446a-b2a0-ab574b800e3a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.529995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.530679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.530924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.531199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.531905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.533282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.535044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901789d-9c96-4741-9c9f-c2457087adbd None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.546824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 452/900] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:38:45 2022] POST /identity/v3/services => generated 241 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:45.547924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.596042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.596991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.597276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.597551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.598301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:45.598604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.600217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.607663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 449/901] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:45.615697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.673893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b67af-0979-46f4-a70b-d46a693c8e63 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.711145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.712217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.712773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.713286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.714316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:45.715018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.716867 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.731159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 453/902] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:45.736590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.753732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd708c-cbe7-49b8-936b-ac22d087e7b5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.802216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.804060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.804060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.804060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.804298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] RBAC: Adding query filter params (interface=public, service_id=60f633d4de284ddab28e6f4e319b0bb0, region_id=RegionOne) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:45.804471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.805815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.812769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 450/903] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/endpoints?service_id=60f633d4de284ddab28e6f4e319b0bb0&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:45.818099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.864313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9bd41-5746-493f-b1fc-b4ec219649ab None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.899880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.901118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.901118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.901319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.909543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.911097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.926837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 14:38:45.928371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 454/904] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:45.937904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3063-3bb4-4e9e-ab00-eafd29ed7c2f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:45.938077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:45.978766 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:45.979615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:45.979992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:45.980921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:45.982614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:45.984400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:45.998010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 451/905] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:38:46.055620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5b9f0-8544-47d3-bab0-4a64d71d9427 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:46.094622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:46.095649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:46.096071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:46.096484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:46.097479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:46.097991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:46.099572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:46.124715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 455/906] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Mar 8 14:38:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:46.126685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:46.228022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2e06-5b83-4d1e-bb92-ab348a662cc0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:46.265909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:46.266892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:46.267318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:46.267760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:46.336580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:46.338303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:46.453345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 452/907] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:38:46.459248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:46.564151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cac0e-7c3b-4f75-a983-9cafe31b5695 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:46.600907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:46.602100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:46.602595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:46.603089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:46.614677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:46.616563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:46.634756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:46.640630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 456/908] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:46.646964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:46.767433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e374ab-6739-4b0b-afe6-4426e894fade None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:46.811630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:46.812749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:46.813250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:46.813743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:46.814719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:46.815253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:46.816908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:46.835822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 453/909] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:46.837800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:46.953453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f18b-500b-4c19-9254-94a121eb51d8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:46.987572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:46.988378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:46.988657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:46.988927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:46.995828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:46.998018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:47.013974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:47.019873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 457/910] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:47.021302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:47.127553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f90afc-a6f7-4e69-b7c9-07655b463a31 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:47.162386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:47.163044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.163320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.163589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.164372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:47.164675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:47.166135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee91b39-f017-4161-92b6-8edc60f8266d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:47.185755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 454/911] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:47.187149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:47.292166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677dd2a-46ea-4fde-9c3c-ffaea8371b9c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:47.330514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:47.331176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.331465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.331789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.332622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] RBAC: Adding query filter params (role.id=06605088e6204e4ab81e5a630b8ba512, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=35aafe4494a046cca9096751b630db04) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:47.332934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:47.334459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693a696-422f-4fe7-bc8a-5524635f33df None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:47.342472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 458/912] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:47 2022] GET /identity/v3/role_assignments?user.id=35aafe4494a046cca9096751b630db04&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=06605088e6204e4ab81e5a630b8ba512 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:47.347637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509a40-6751-44f3-979b-d40ac571841a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.347927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509a40-6751-44f3-979b-d40ac571841a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.348210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509a40-6751-44f3-979b-d40ac571841a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.350191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 455/913] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:47.356729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.357317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.357810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.376381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:47.378248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:47.453987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 459/914] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:47.477342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20509a40-6751-44f3-979b-d40ac571841a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:47.588850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20509a40-6751-44f3-979b-d40ac571841a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:47.623160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:47.623974 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.624257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.624535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.625189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:47.626599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:47.637999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 14:38:47.639586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 456/915] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:47.645454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:47.744990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdced614-cf02-4dea-95c1-61ea2ef2bdd8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:47.783571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:47.784599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.785082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.785582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.786690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:47.787207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:47.788776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:47.795087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 460/916] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:47.800842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:47.904871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb184c-55bc-4cf8-b541-95ba8fa87da1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:47.939694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:47.941037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:47.941037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:47.941329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:47.941986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:47.942296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:47.943692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b1e6-865d-47ae-892d-9121c8a38151 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:47.951763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 457/917] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Mar 8 14:38:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:47.957246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.060702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca045259-dc1a-44ca-a89a-03c80d03846b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.095956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcf141-e2b0-42b1-8a8d-65dca5672163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:48.096618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf141-e2b0-42b1-8a8d-65dca5672163 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.096903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf141-e2b0-42b1-8a8d-65dca5672163 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.097179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf141-e2b0-42b1-8a8d-65dca5672163 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.097957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf141-e2b0-42b1-8a8d-65dca5672163 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:48.099333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf141-e2b0-42b1-8a8d-65dca5672163 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:48.122273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 461/918] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:38:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:48.147775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba79b7-a83e-4c02-892a-d6c79ead828c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.148791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba79b7-a83e-4c02-892a-d6c79ead828c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.149272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba79b7-a83e-4c02-892a-d6c79ead828c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.151461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 458/919] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:48.158812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.159413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.159905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.177928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:48.179453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:48.257341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 462/920] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:48.282158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba79b7-a83e-4c02-892a-d6c79ead828c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.394253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba79b7-a83e-4c02-892a-d6c79ead828c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.426909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:48.427651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.427934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.428264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.428916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:48.430390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:48.442729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-973d37fb-7c8a-416e-97fa-da09d38976bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 14:38:48.444301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 459/921] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:48.451039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.533233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69049b8-1cd5-40a8-beb5-a9db4aba5afb None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.533584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69049b8-1cd5-40a8-beb5-a9db4aba5afb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.533796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69049b8-1cd5-40a8-beb5-a9db4aba5afb None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.535755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 460/922] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:48.540544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.540831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.541113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.554497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6fff0-4801-479d-9bb3-7cea6e36f00f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.561428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:48.562670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:48.595554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:48.596224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.596507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.596785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.597488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:48.597794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:48.599214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:48.609874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 463/923] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:48.611816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.653871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 461/924] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:48.675872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.731827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7602f-a265-4c5d-af02-f6db57f0120a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.775542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:48.775863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2e2b-6fce-4d8d-8ded-4b8af2a6e3ef None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.776209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.776503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.776784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.777926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:48.778338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:48.781057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:48.787738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 464/925] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:48.793412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.816452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:48.817618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.818133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.818625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.819460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:48.821022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:48.833536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 14:38:48.835269 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 462/926] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:48.841923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:48.915808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f990c-5098-4fe9-9222-10b6e1ad27cd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.958724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:48.959728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:48.960236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:48.961137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:48.962450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] RBAC: Adding query filter params (interface=public, service_id=490e1bc733784980b7bff937fa1e26b2, region_id=RegionOne) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:48.963106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:48.965847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:48.972573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2981-7c10-4a04-87f3-d6b41a33a8a7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:48.973338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 465/927] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/endpoints?service_id=490e1bc733784980b7bff937fa1e26b2&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:48.979377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:49.017733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:49.018505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:49.018800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:49.019189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:49.019899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:49.020207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:49.021748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:49.027961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 463/928] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:49.033119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:49.098564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3199c0-ceef-4d55-bcac-da23d628ef1a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:49.136200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:49.136937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:49.137220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:49.137591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:49.138302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:49.139672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:49.145825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 466/929] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:48 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:38:49.160845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacccb6-35d9-4e16-b705-99579b1a6f1b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:49.204840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:49.205933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:49.206441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:49.206909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:49.207855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:49.208386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:49.210077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9fd42-22a6-472b-b4cc-f24d93e04cbf None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:49.216794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 464/930] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:49.225983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:49.340468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa49af-ff55-4a41-bed8-68724b20f222 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:49.377767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8d387-fce5-46b3-9e75-54a6a0d3f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:49.378726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d387-fce5-46b3-9e75-54a6a0d3f4de None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:49.379164 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d387-fce5-46b3-9e75-54a6a0d3f4de None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:49.379592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d387-fce5-46b3-9e75-54a6a0d3f4de None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:49.380528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8d387-fce5-46b3-9e75-54a6a0d3f4de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:49.382136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8d387-fce5-46b3-9e75-54a6a0d3f4de None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:49.405125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 467/931] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:38:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:49.853258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c4595-a40c-4853-96ae-268ff25e6481 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:49.853599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c4595-a40c-4853-96ae-268ff25e6481 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:49.853814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c4595-a40c-4853-96ae-268ff25e6481 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:49.856768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 465/932] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:49.862041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:49.862329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:49.862608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:49.879190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:49.880431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:49.956694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 468/933] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:49.980937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c4595-a40c-4853-96ae-268ff25e6481 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.083437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c4595-a40c-4853-96ae-268ff25e6481 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:50.117185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:50.117938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.118226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.118501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.130124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:50.138111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 14:38:50.139694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 466/934] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Mar 8 14:38:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:50.145441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.253096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010062e-c30b-462a-9f78-30a7b937c233 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:50.288546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:50.289225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.289510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.289785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.290563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:50.290873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:50.292249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:50.300547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 469/935] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:38:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:50.306067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.408210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dff595-6d85-4abe-8c53-cb0f33e247ee None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:50.443339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:50.444145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.444429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.444694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.457991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:50.460224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:50.480799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3598f363-e991-4571-a278-ec21726b7a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:50.482365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 467/936] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:50.488020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.590891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f69cc-5e9b-4e96-b122-9cbd3e962339 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.591244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f69cc-5e9b-4e96-b122-9cbd3e962339 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.591506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f69cc-5e9b-4e96-b122-9cbd3e962339 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.592703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f1827-1bff-4697-a1c4-03680f7e095d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:50.593649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 468/937] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:50.599821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.600110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.600389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.621318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:50.622538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:50.627953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:50.628853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.629358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.629811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.630723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:50.631220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:50.632773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:50.645473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 470/938] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:50.651325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.698685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 469/939] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:50.723140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.765984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3e37-0488-4d76-8fdf-158e7bc1655a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:50.812989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:50.814316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.814739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.815019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.824936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:50.827482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:50.834556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2e4bd-72e4-4a6c-98af-a52fddead234 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:50.846202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 14:38:50.848337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 471/940] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:38:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:50.853026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.872520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:50.873505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:50.874016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:50.874520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:50.875417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:50.877047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:50.878612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.common [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 08 14:38:50.897023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.sql.core [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 08 14:38:50.897023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 08 14:38:50.897023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [parameters: {'id': '842556911d964925a7a1a896e2db1c14', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 08 14:38:50.897023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 14:38:50.905583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 842556911d964925a7a1a896e2db1c14.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 842556911d964925a7a1a896e2db1c14. Mar 08 14:38:50.907483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 470/941] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Mar 8 14:38:50 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:50.913345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:50.967702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b16a-009a-4602-a59d-9e9a37669315 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.002754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.003507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.003709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.003989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.004885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:51.005197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.006789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.030007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 472/942] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Mar 8 14:38:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:51.030803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc1f9-2f34-4f90-8bdd-c8d15125bee6 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.031593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.064949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.066144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.066637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.067114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.074834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.077171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.092575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:51.098827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 471/943] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:51.100672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.133837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526ac1-c305-4e7e-8c36-6ae04f65e32a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.169897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.170852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.171229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.171670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.182277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.184445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.204083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:51.210288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 473/944] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:51.211921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.226225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228de3-5f3e-4838-ad14-bd39c0c276ce None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.271056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.272068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.272660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.273089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.274687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:51.275168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.277580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.310138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 472/945] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:51.322523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e18d6-6618-49da-9665-092d047f2404 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.360434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.361381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.361671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.361974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.362759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:51.363072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.364511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.377839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 474/946] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:51.383794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.497024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a8e7-c172-4c8f-9a1a-5a0f8e42b1e6 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.537418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.538251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.538534 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.538811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.546410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.548718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.563445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ac419900-6fc5-4777-b585-efd393da2443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:51.564978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 473/947] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:51.570680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.580077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f985-86d0-4a67-b4ce-566fb295b825 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.580369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f985-86d0-4a67-b4ce-566fb295b825 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.580639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0f985-86d0-4a67-b4ce-566fb295b825 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.582732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 474/948] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:51.588011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.588339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.588601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.610771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:51.612593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:51.686666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 475/949] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:51.698747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde971-9b0e-4ad7-9272-4ccd89c4fd42 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.710947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.739447 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.740118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.740406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.740685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.741633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:51.741971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.744019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.760970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 475/950] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:51.768159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.836774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b784a6-8ba4-490a-af02-1df37cf79fbc None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.868065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2622-87de-4016-8091-5c9ef4428c35 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:51.877522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.878361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.878636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.878904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.879545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.880913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.892498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-64d4ab96-f154-4d20-8d34-1e738ad68687 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 14:38:51.893682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 476/951] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:51.899882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b258-cfb0-46d2-8c56-c5810c9a6cdf None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.900164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b258-cfb0-46d2-8c56-c5810c9a6cdf None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.900465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b258-cfb0-46d2-8c56-c5810c9a6cdf None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.902936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 477/952] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:51.903595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8b258-cfb0-46d2-8c56-c5810c9a6cdf None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:51.906362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6874-1321-4c3e-af82-96569743270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:51.907384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6874-1321-4c3e-af82-96569743270d None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.907674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6874-1321-4c3e-af82-96569743270d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.907956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6874-1321-4c3e-af82-96569743270d None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/35aafe4494a046cca9096751b630db04/roles/06605088e6204e4ab81e5a630b8ba512` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.910249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6874-1321-4c3e-af82-96569743270d None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=35aafe4494a046cca9096751b630db04, role_id=06605088e6204e4ab81e5a630b8ba512)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:51.911688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6874-1321-4c3e-af82-96569743270d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:51.932771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 476/953] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:38:51 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/35aafe4494a046cca9096751b630db04/roles/06605088e6204e4ab81e5a630b8ba512 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:38:51.935145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937138-1d96-4e69-b496-3db90a725642 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:51.935753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937138-1d96-4e69-b496-3db90a725642 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:51.936235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937138-1d96-4e69-b496-3db90a725642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:51.966140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-26937138-1d96-4e69-b496-3db90a725642 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:51.968239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-26937138-1d96-4e69-b496-3db90a725642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:52.053315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8b258-cfb0-46d2-8c56-c5810c9a6cdf None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:52.065967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 477/954] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:52.089055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937138-1d96-4e69-b496-3db90a725642 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:52.107216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:52.108413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:52.109207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:52.109687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:52.110682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:52.110992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:52.112381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:52.117886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 478/955] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:52.124847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:52.216950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937138-1d96-4e69-b496-3db90a725642 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:52.234142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf07d-afdc-46b0-8f13-2adea2cb299e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:52.257527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:52.258366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:52.258644 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:52.258915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:52.259559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:52.261085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:52.272540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 14:38:52.273501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:52.274048 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 478/956] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:52.274415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:52.274700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:52.274967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:52.275666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:52.275964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:52.277884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:52.280578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:52.283590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 479/957] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:52.290830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:52.381282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200d188-e12d-4285-b4d3-2c4366e046d8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:52.416757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:52.417427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:52.418479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886675b-3dbc-4846-9ba6-2331f40e71bb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:52.418919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:52.418919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:52.419594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:52.419901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:52.421447 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:52.429945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 479/958] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:52.432645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:52.470189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3f2f-ed23-4490-8866-d4a93c585614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:52.470864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3f2f-ed23-4490-8866-d4a93c585614 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:52.471157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3f2f-ed23-4490-8866-d4a93c585614 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:52.471741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3f2f-ed23-4490-8866-d4a93c585614 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:52.472766 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3f2f-ed23-4490-8866-d4a93c585614 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:52.474200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3f2f-ed23-4490-8866-d4a93c585614 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:52.501932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 480/959] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:38:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:52.554666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c7a7-1b1d-42b6-87ec-01d4c31304fb None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:52.599498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:52.601021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:52.601505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:52.602087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:52.603044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] RBAC: Adding query filter params (type=compute) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:52.603554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:52.605779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192f0f-4a7e-4018-a357-91bc3292842e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:52.611714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 480/960] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:53.757838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa211-184c-4a0c-9010-e2c696e85b31 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:53.758373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa211-184c-4a0c-9010-e2c696e85b31 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:53.758479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa211-184c-4a0c-9010-e2c696e85b31 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:53.760512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 481/961] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:53.767391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:53.767900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:53.767971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:53.785793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:53.787025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:53.854474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 481/962] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:53.879874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa211-184c-4a0c-9010-e2c696e85b31 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:53.984599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa211-184c-4a0c-9010-e2c696e85b31 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:54.021505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:54.022133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.022415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.022689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.023401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:54.024845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:54.041604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.sql.core [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 08 14:38:54.041604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 08 14:38:54.041604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [parameters: {'user_id': '78e4820210044ca5b64cec53ced30395', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 08 14:38:54.041604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 14:38:54.048236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 08 14:38:54.049970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 482/963] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Mar 8 14:38:53 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:54.059037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:54.158471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c54e-1a46-46e2-a3be-e43fce64ae2c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:54.192278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:54.193535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.194095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.194593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.203282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:54.204980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:54.220295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-eb31fc2d-9fc5-4601-bb81-3985ad48dbd9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 14:38:54.225930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 482/964] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:38:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:54.228270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:54.330921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa800-1d9a-4c84-be3e-fb29223caa10 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:54.354179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ceb8f-8243-4f23-a7c4-cd36fdb610ce None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.354811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ceb8f-8243-4f23-a7c4-cd36fdb610ce None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.356004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ceb8f-8243-4f23-a7c4-cd36fdb610ce None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.361986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 483/965] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:54.364067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.364595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.365078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.366207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:54.366874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.367155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.367429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.368330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:54.368725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:54.370491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:54.384727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:54.385943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:54.410205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 483/966] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Mar 8 14:38:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:54.472117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 484/967] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:54.497270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:54.611280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a413-b5fb-4c18-8783-6e11b543c55b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:54.649557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:54.650422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.650702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.650972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.663436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:38:54.671801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 14:38:54.673406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 484/968] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Mar 8 14:38:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:54.679693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:54.784639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1dd04-b9d7-4b22-b027-c59aa19569d7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:54.818395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:54.819069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.819355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.819635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.820378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:54.820690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:54.822110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4c478-5c4f-4fb3-809d-3c775b858ff4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:54.830915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 485/969] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:38:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:54.836384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:54.941224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0611f6-65ef-4ce0-a0f8-d162c740f1c8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:54.975124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:54.975763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.976038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.976308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.976638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b93665-fd00-4162-86c6-80eea965b3b8 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.976933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b93665-fd00-4162-86c6-80eea965b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.977214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b93665-fd00-4162-86c6-80eea965b3b8 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.979016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 486/970] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:54.984792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a03d9-3dde-49df-801e-a0f34e6a0822 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:54.985077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a03d9-3dde-49df-801e-a0f34e6a0822 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:54.985352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a03d9-3dde-49df-801e-a0f34e6a0822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:54.987596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:54.989071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.002737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-517a03d9-3dde-49df-801e-a0f34e6a0822 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:55.003912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-517a03d9-3dde-49df-801e-a0f34e6a0822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:55.006547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:55.007899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 485/971] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:55.013181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.069353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 487/972] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:55.070721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b51a53-de14-4f3f-ae97-a2ea0bd2ce0c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.071006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b51a53-de14-4f3f-ae97-a2ea0bd2ce0c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.071283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b51a53-de14-4f3f-ae97-a2ea0bd2ce0c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.073083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 488/973] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:55.078782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.079066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.079344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.095823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:55.096987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:55.110202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0a4e-159a-49f5-aa9f-49d338f9092b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.141348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.142027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.142325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.142596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.143303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:55.143604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.144962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.156882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 486/974] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:55.158469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.159859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 489/975] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:55.162378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.252582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ede44-911b-4a76-8f83-6dc73331e7c1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.256507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabb746-cd19-4b11-bd9c-8a6e563cd7f0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.285101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.285761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.286064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.286339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.287044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.288407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.290240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.291052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.291335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.291614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.300051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.301468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.302041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 487/976] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:38:55 2022] POST /identity/v3/services => generated 242 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:55.302835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.316570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 14:38:55.318007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 490/977] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:55.323972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.421683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb42c5f-ca48-49f0-b8d4-251886ec192e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.430924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e6eec-9813-40e3-99a8-5466f8a35a93 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.458472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.459294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.459581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.459911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.460583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.462050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.473535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.474537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.475062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.475495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.475686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 14:38:55.476679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:55.476929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 488/978] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:55.477283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.478884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.483265 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.500767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 491/979] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:55.507012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.585466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134630-4ab9-4246-876c-a83e3939de78 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.610641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c22bb-bb73-4b35-9968-2983b81f5792 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.618300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.619409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.619702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.619984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.621084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:55.621407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.623415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.634024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 489/980] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:55.635415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.644950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.645621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.645892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.646169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.711821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.713295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.734630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef199-2ef1-4ce2-88aa-0e555761e529 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.771331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.772241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.772525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.772826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.773532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:55.773840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.775258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.780753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 490/981] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:55.786353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.819430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 492/982] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:38:55.825818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.887830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb0256-a211-4a79-8b3d-ca8d4e2fe086 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.919725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.920389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.920678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.920780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14b60-9fcd-4904-af38-aadcf9fcbc2d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:55.920954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.921740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] RBAC: Adding query filter params (interface=admin, service_id=490e1bc733784980b7bff937fa1e26b2, region_id=RegionOne) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:55.922083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.923459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.932613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 491/983] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/endpoints?service_id=490e1bc733784980b7bff937fa1e26b2&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:55.934148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:55.966449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:55.967242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:55.967548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:55.967796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:55.977486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:55.979005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:55.996608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:38:55.997796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 493/984] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:38:56.003278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:56.034429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27e6f-28b0-4d8b-a568-c0326a656389 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:56.066812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:56.067517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:56.067802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:56.068080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:56.068759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:56.070173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:56.076732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 492/985] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:55 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:38:56.102862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4061c5e-3bb1-4364-b596-650f501483fc None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:56.140185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:56.140879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:56.141164 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:56.141443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:56.142220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:56.142531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:56.143991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:56.161566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 494/986] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:38:56.163023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:56.270074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69611f9e-248f-48de-8d64-1712660b9148 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:56.304139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:56.304877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:56.305157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:56.305429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:56.312622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:56.314104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:56.328691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:38:56.330076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 493/987] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:56.335642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:56.440004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da235450-4593-4598-9dd9-b1ababd2caeb None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:56.477246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:56.477938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:56.478223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:56.478498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:56.479277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:56.479584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:56.482138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ca1a9-1955-4b12-abdb-022d057adf57 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:56.495405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 495/988] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:56.501519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:56.597441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc8899-373d-4d4a-865d-a1981773fadc None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:56.630161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:56.630810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:56.631087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:56.631356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:56.632170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] RBAC: Adding query filter params (role.id=06605088e6204e4ab81e5a630b8ba512, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=35aafe4494a046cca9096751b630db04) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:56.632482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:56.634012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247c504-3a5c-447c-9c7d-bd228cf0679c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:56.640340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 494/989] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:38:56 2022] GET /identity/v3/role_assignments?user.id=35aafe4494a046cca9096751b630db04&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=06605088e6204e4ab81e5a630b8ba512 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:57.645639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d62ec-ac47-44d5-89d8-aa518be5981d None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:57.646187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d62ec-ac47-44d5-89d8-aa518be5981d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:57.646264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d62ec-ac47-44d5-89d8-aa518be5981d None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:57.648105 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 496/990] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:38:57.653541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:57.654008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:57.654091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:57.671626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:57.673127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:57.740211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 495/991] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:38:57.764068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d62ec-ac47-44d5-89d8-aa518be5981d None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:57.863623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d62ec-ac47-44d5-89d8-aa518be5981d None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:57.895991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:57.896711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:57.896995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:57.897271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] PATH_INFO: `/v3/services/compute` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:57.898014 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:57.899380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:57.910463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 14:38:57.911802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 497/992] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:38:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:57.918339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.023232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbe47-dfba-43f1-babb-d2998384766b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.059462 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.061980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.061980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.061980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.061980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] RBAC: Adding query filter params (name=compute) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:58.061980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.063078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.072360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 496/993] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:58.073571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.170223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfa780-a661-4531-9a96-6b1fda6d286c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.201735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.202443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.202730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.203009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.203705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:58.204011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.205367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.210113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 498/994] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:38:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:58.216335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.312638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcceba-52fe-4d6f-bd71-5099d13d849b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.344975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.345633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.345938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.346212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.346989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] RBAC: Adding query filter params (interface=public, service_id=057a4a072cea499182fbb3c2ee2dc355, region_id=RegionOne) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:58.347299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.348733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4cdd-2666-4364-9564-112a51870caf None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.358799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 497/995] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:38:58 2022] GET /identity/v3/endpoints?service_id=057a4a072cea499182fbb3c2ee2dc355&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:58.360069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.395301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fea4d-6155-42e1-b402-b4514b24bb7a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.395582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fea4d-6155-42e1-b402-b4514b24bb7a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.396013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fea4d-6155-42e1-b402-b4514b24bb7a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.397952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 498/996] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:58.403789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.404076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.404361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.421276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:58.422418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:58.458405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b6695-c421-444c-be5d-56ebc59d4c43 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.488209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 499/997] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:58.491384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.492056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.492341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.492624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.493304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.494702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.510050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 499/998] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:38:58 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:38:58.511914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.618235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288b25-68d0-4303-b1bb-43d958598f89 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.654170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.655016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.655302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.655576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.656248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.657714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.670695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 14:38:58.672235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 500/999] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Mar 8 14:38:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:58.678485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.781474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c5884-b58f-4499-befe-40542d876c68 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.814233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.814898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.815179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.815499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.816202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:58.816507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.817884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.822719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 500/1000] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:58.829152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:58.926034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b091b-3214-474a-b491-6184ae3a54d1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:58.964150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:58.965122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:58.965585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:58.966067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:58.966942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:58.967457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:58.969021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e154c-90c7-4fe1-8d16-dadc1c38f8fd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:58.973805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 501/1001] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Mar 8 14:38:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:58.979531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:59.041646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5456-84bb-456d-a133-51a4009084c7 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:59.041964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5456-84bb-456d-a133-51a4009084c7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:59.043001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab5456-84bb-456d-a133-51a4009084c7 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:59.045335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 502/1002] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:38:59.050457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:59.050748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:59.051035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:59.067354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:38:59.068544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:38:59.080464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386091a5-8e55-4f09-b6a8-714aaa4df70f None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:59.113588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:59.114279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:59.114561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:59.114837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:59.115571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:59.116928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:59.141906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 501/1003] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:38:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:38:59.155564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 503/1004] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:38:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:38:59.179358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:59.287294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb01e0c-c684-40c8-899f-af51b525028d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:59.324145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:59.325169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:59.325527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:59.325757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] PATH_INFO: `/v3/services/image` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:59.326442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:59.327885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:59.340402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 14:38:59.341594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 502/1005] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Mar 8 14:38:59 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:38:59.347464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:59.443673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3f028-270a-46ec-aebc-e84fe4c4a2de None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:59.476036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:59.476701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:59.476977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:59.477246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:59.477962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] RBAC: Adding query filter params (name=image) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:59.478264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:59.479634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a5603-180e-408a-bba1-5c71d35457ae None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:59.485233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 504/1006] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:38:59.490887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:38:59.586463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1561508-cec5-4394-95b3-8e7b4c6c010b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:38:59.618496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:38:59.619152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:38:59.619434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:38:59.619704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:38:59.620395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] RBAC: Adding query filter params (type=image) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:38:59.620722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:38:59.622091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2baf44-3487-4672-9412-12f3524a4a5f None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:38:59.626504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 503/1007] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:38:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:00.837298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bcaaa-d364-4c6b-b0df-599f7e6a7017 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:00.837820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bcaaa-d364-4c6b-b0df-599f7e6a7017 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:00.837820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bcaaa-d364-4c6b-b0df-599f7e6a7017 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:00.840479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 505/1008] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:00.845817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:00.846240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:00.846389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:00.862865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:00.864039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:00.926920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 504/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:00.950466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bcaaa-d364-4c6b-b0df-599f7e6a7017 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:01.046492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bcaaa-d364-4c6b-b0df-599f7e6a7017 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:01.079794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:01.080590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.080868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.081136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] PATH_INFO: `/v3/services/compute` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.081774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:01.083167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:01.094371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 14:39:01.095622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 506/1010] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:39:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:01.101494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:01.198207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dacb-6387-470b-9927-5a2390153e02 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:01.231535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:01.232199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.232475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.232745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.233436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:01.233735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:01.235115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:01.239856 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 505/1011] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:39:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:01.245334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:01.341308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23236e61-4d66-45ff-a834-42b98917d6da None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:01.373033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:01.373630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.373945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.374223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.374929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:01.375238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:01.376622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26016945-e43b-47ba-bf7c-78d2b1602412 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:01.381776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 507/1012] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Mar 8 14:39:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:01.387635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:01.484561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b859a-47dc-4ea5-b470-4d498023e354 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:01.518006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28168b-765b-412f-8d4d-9072be8a1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:01.518666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28168b-765b-412f-8d4d-9072be8a1472 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.518950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28168b-765b-412f-8d4d-9072be8a1472 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.519226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28168b-765b-412f-8d4d-9072be8a1472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.519962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28168b-765b-412f-8d4d-9072be8a1472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:01.521353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28168b-765b-412f-8d4d-9072be8a1472 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:01.541960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 506/1013] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:39:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:01.547750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b098-ff68-4662-aa8d-fca1bbf0f4e4 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.548160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b098-ff68-4662-aa8d-fca1bbf0f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.548512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70b098-ff68-4662-aa8d-fca1bbf0f4e4 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.550693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 508/1014] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:01.556635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.556950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.557220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.577250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:01.578523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:01.656572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 507/1015] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:01 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:01.680496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b098-ff68-4662-aa8d-fca1bbf0f4e4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:01.784621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70b098-ff68-4662-aa8d-fca1bbf0f4e4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:01.818674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101fa5b-034f-4028-bbc0-68fe2fa61f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:01.819478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101fa5b-034f-4028-bbc0-68fe2fa61f03 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.819761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101fa5b-034f-4028-bbc0-68fe2fa61f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.820036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101fa5b-034f-4028-bbc0-68fe2fa61f03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.821191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101fa5b-034f-4028-bbc0-68fe2fa61f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:01.822672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101fa5b-034f-4028-bbc0-68fe2fa61f03 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:01.824730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 509/1016] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:01.831114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:01.928339 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20f04d-8352-407f-bbaf-6b0f9a507e5a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:01.945890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa66e-d5a3-459f-a6af-ebb35633e6b7 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.946808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa66e-d5a3-459f-a6af-ebb35633e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.947290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa66e-d5a3-459f-a6af-ebb35633e6b7 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.949795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 510/1017] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:39:01.956332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629518aa-95c3-4306-a8fd-0e73e8397a51 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.956690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629518aa-95c3-4306-a8fd-0e73e8397a51 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.957213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629518aa-95c3-4306-a8fd-0e73e8397a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.965429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:01.966163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:01.966441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:01.966719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:01.967435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:01.968871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:01.975284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-629518aa-95c3-4306-a8fd-0e73e8397a51 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:01.976546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-629518aa-95c3-4306-a8fd-0e73e8397a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:02.005882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 508/1018] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:39:01 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:39:02.053344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 511/1019] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:01 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:39:02.075477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:02.178968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c2efa-ef0a-488a-bbae-a0c1325044f7 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:02.213105 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cda4f-2fc2-4c92-9a75-3f6b6cfe3039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:02.213774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cda4f-2fc2-4c92-9a75-3f6b6cfe3039 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:02.214732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cda4f-2fc2-4c92-9a75-3f6b6cfe3039 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:02.215036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cda4f-2fc2-4c92-9a75-3f6b6cfe3039 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:02.215769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cda4f-2fc2-4c92-9a75-3f6b6cfe3039 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:02.217139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cda4f-2fc2-4c92-9a75-3f6b6cfe3039 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:02.230959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 509/1020] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:39:02 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:03.966214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5ab4-5877-4432-859e-c9b2663464de None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:03.966715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5ab4-5877-4432-859e-c9b2663464de None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:03.966818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d5ab4-5877-4432-859e-c9b2663464de None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:03.968506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 512/1021] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:03.974050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:03.974454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:03.974633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:03.991773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:03.992942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:04.067144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 510/1022] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:04.091137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d5ab4-5877-4432-859e-c9b2663464de None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.186947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d5ab4-5877-4432-859e-c9b2663464de None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.223307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39aa0d-51be-4ed1-bdd0-0e50650ed7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.224108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39aa0d-51be-4ed1-bdd0-0e50650ed7e6 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.224387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39aa0d-51be-4ed1-bdd0-0e50650ed7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.224661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39aa0d-51be-4ed1-bdd0-0e50650ed7e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.235455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39aa0d-51be-4ed1-bdd0-0e50650ed7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:04.243044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-3a39aa0d-51be-4ed1-bdd0-0e50650ed7e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 14:39:04.249181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 513/1023] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:04.250760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.344006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22730d-bd6c-4c32-95bc-c6a68247c200 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.375928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.376593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.376873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.377145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.377898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:04.378205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:04.379555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:04.382020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3aa8-7499-490c-982c-6ee5c3e3e5e5 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.382316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3aa8-7499-490c-982c-6ee5c3e3e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.382601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3aa8-7499-490c-982c-6ee5c3e3e5e5 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.384506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 514/1024] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:39:04.387991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 511/1025] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:04.389753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.390092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.390374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.393367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.408112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:04.409286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:04.475105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 515/1026] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:39:04.497280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b48ef-4b60-42b1-b6a4-952a5f9a2291 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.499829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.531725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.532527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.532807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.533080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.543658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:04.545091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:04.561490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-01a67dfc-25fb-4fd3-86a8-69be208f5fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:04.562700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 512/1027] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:04.563886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f20a9-2967-4e36-8ce1-e9a778c43b4f None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.564168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f20a9-2967-4e36-8ce1-e9a778c43b4f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.564441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f20a9-2967-4e36-8ce1-e9a778c43b4f None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.566451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 513/1028] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:04.570921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f20a9-2967-4e36-8ce1-e9a778c43b4f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.594325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9935-6178-4752-a222-2aaeb26e1bd8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.626306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e83f4-c073-45f6-9753-3072bcca75a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.627090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e83f4-c073-45f6-9753-3072bcca75a2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.627363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e83f4-c073-45f6-9753-3072bcca75a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.627628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e83f4-c073-45f6-9753-3072bcca75a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.628767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e83f4-c073-45f6-9753-3072bcca75a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:04.630240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e83f4-c073-45f6-9753-3072bcca75a2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:04.631849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 516/1029] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:04.632970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.633239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.633512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.649612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:04.650863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:04.671385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f20a9-2967-4e36-8ce1-e9a778c43b4f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.705056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.705706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.706019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.706300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.707024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:04.707309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:04.708659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:04.713156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 517/1030] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:04.713992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.720198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 514/1031] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:04.725576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.809556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f6083-d4b1-45c2-9261-35252d3c56f7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.821010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c4b8b-c9ba-4186-b2a5-7cafba092bd6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:04.841542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.842227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.842503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.842772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.843466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:04.844894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:04.853628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:04.854403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:04.854763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:04.855621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:04.863345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:04.863852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 518/1032] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:39:04 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:04.864649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.864812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:04.879853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:39:04.881112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 515/1033] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:04.887854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:04.986990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f3ae6-7727-4be9-9ac5-39fb8fb92ac0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.002165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addc481-c78e-4ed3-8c16-fac89274ca36 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.023721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.024895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.025369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.025637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] PATH_INFO: `/v3/services/image` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.026336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.028937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.036809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.037489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.037771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.038076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.038913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:05.039223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.040683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.040841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 14:39:05.048003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 519/1034] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:05.049684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.060455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 516/1035] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:39:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:05.065887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.158751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0865a2b-e3f4-4086-bcb9-5d8d8a088c8c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.171263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea554f-88d4-4c1a-b3e9-6c653538e7cd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.193498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.194186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.194467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.194740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.195433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] RBAC: Adding query filter params (name=image) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:05.195732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.197148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.202913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 520/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:05.205009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.205653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.205959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.206235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.208219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.270690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.272045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.305682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b21735-0f82-48ee-b5cd-f4a1c08aa792 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.338015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.338679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.338978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.339779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.340470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] RBAC: Adding query filter params (type=image) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:05.340772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.342167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.351486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 521/1037] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:05.352754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.375587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 517/1038] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:39:05.376630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.450488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79af53-e45a-4a84-a53f-77e113455d1f None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.475612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379972-e316-425c-b24d-f6e960a0a71c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.483756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.484656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.484656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.484947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.485724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] RBAC: Adding query filter params (interface=public, service_id=bc93d9e22ad547399ee445c263f82010, region_id=RegionOne) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:05.486072 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.487445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.492342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 522/1039] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/endpoints?service_id=bc93d9e22ad547399ee445c263f82010&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:05.497778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.511802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.512790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.513233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.513551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.523768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.526071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.548201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:05.549399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 518/1040] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:05.554836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.595478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64c92-b171-4507-a261-6bf8ace86f7d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.628344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.629264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.629546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.629823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.630528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.631896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.639184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 523/1041] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/services => generated 1957 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:39:05.653223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a2daf-1d6c-452d-b405-aa894490cbf1 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.689166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.689844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.690144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.690419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.691145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:05.691450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.692868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.706886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 519/1042] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:05.712433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.815257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48386a5a-b165-4ac0-a703-09d37f4fd55e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:05.849594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:05.850435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:05.850714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:05.850991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:05.857639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:05.859141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:05.873727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:39:05.875105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 524/1043] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:05.880688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:05.985587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b19a8-7093-4816-ae8e-2869a96fc498 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:06.017864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:06.018628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:06.018822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:06.019095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:06.019868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:06.020176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:06.021590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b0afc-cf1c-4161-b43b-8ef66ed9d2aa None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:06.038325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 520/1044] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:06.039533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:06.136367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae1e89-62f9-4e66-b46c-26361c70a020 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:06.169478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:06.170156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:06.170435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:06.170707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:06.171508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] RBAC: Adding query filter params (role.id=06605088e6204e4ab81e5a630b8ba512, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=54185e0e2c5549f3b397a8009ae27713) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:06.171816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:06.173234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcf74f-c405-407b-b790-7d7544b3696f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:06.181949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 525/1045] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:06 2022] GET /identity/v3/role_assignments?user.id=54185e0e2c5549f3b397a8009ae27713&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=06605088e6204e4ab81e5a630b8ba512 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:07.328049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d607ad1-60ad-4526-816d-71d6888f97a2 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:07.328565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d607ad1-60ad-4526-816d-71d6888f97a2 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:07.328642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d607ad1-60ad-4526-816d-71d6888f97a2 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:07.330528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 521/1046] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:07.335578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:07.335972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:07.336130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:07.353933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:07.355705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:07.421982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 526/1047] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:07.445382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d607ad1-60ad-4526-816d-71d6888f97a2 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:07.546828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d607ad1-60ad-4526-816d-71d6888f97a2 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:07.580676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:07.581398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:07.581716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:07.581978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:07.593002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:07.600095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:07.601518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 522/1048] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:07.608192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:07.708764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d03ef5-64c0-4cca-b7d0-7077d0487b03 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:07.741101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:07.741778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:07.742094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:07.742374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:07.743120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:07.743428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:07.744805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff1bc6-53df-495d-8f06-3179cd224542 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:07.753431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 527/1049] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:07.758911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:07.855798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc135-fb98-4527-8e74-3a8afa4c6055 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:07.889390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:07.890288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:07.890572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:07.890848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] PATH_INFO: `/v3/users/45b75d56d4144d69938bfcb49166224d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:07.998911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eb022-6111-4778-be76-89249978b572 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:07.999246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eb022-6111-4778-be76-89249978b572 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:07.999485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eb022-6111-4778-be76-89249978b572 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.005493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 528/1050] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:39:08.007397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.007697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.007981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.025729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:08.026769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] RBAC: Authorizing `identity:get_user(user_id=45b75d56d4144d69938bfcb49166224d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.027283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:08.028308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.030028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 523/1051] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:07 2022] GET /identity/v3/users/45b75d56d4144d69938bfcb49166224d => generated 285 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:08.035468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.093082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 529/1052] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:08.116368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.134998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d497dd1-58ad-4cc7-bd93-aae9cd8dd1ef None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.169220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.169887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.170182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.170451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.212965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9151-43d8-488c-9284-19964e2786bb None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.236265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.237996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.250709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.252040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.252335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.252747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.253536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.255406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.270858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 14:39:08.277689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 530/1053] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:08.278842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.334268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 524/1054] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:39:08.340561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.392765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0a6f6-e96d-44dc-81f9-3ae82bef10f2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.426771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.427440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.427720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.427994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.428692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] RBAC: Adding query filter params (name=image) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:08.428996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.430402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.440007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 531/1055] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:08.440178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88c23e-95d7-4817-a5a6-93e657dca8ef None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.440997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.474086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a95f71-02d8-409f-9e98-17df463000a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.474943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a95f71-02d8-409f-9e98-17df463000a1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.475223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a95f71-02d8-409f-9e98-17df463000a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.475494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a95f71-02d8-409f-9e98-17df463000a1 None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.476660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a95f71-02d8-409f-9e98-17df463000a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c782d15d18884ca898787c2d58522ebb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.478106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a95f71-02d8-409f-9e98-17df463000a1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.480350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 525/1056] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/projects/c782d15d18884ca898787c2d58522ebb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:08.481520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dd84f-d8e6-4a0a-bdd7-2c9010494d0c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.481800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dd84f-d8e6-4a0a-bdd7-2c9010494d0c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.482109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dd84f-d8e6-4a0a-bdd7-2c9010494d0c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.485486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 526/1057] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:08.486180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dd84f-d8e6-4a0a-bdd7-2c9010494d0c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.538809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce54167-ea71-473b-a176-25f0b13feca2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.570065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.570720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.571000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.571271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.572019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] RBAC: Adding query filter params (type=image) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:08.572324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.574304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006823b-81d6-48e8-abba-0b5337f54745 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.579305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 532/1058] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:08.580612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.580903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.581079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dd84f-d8e6-4a0a-bdd7-2c9010494d0c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.581197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.598776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:08.599960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:08.613750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.614432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.614718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.614997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.616207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=c782d15d18884ca898787c2d58522ebb, user.id=45b75d56d4144d69938bfcb49166224d) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:08.616519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.618047 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.624120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 527/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/role_assignments?user.id=45b75d56d4144d69938bfcb49166224d&scope.project.id=c782d15d18884ca898787c2d58522ebb&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:08.624891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.668438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 533/1060] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:08.695190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.732131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289776-22c2-48a1-8922-357e8de10448 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.773638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.774356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.774634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.774913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.775662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:08.777074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:08.799172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 528/1061] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:39:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:08.800012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4112d-4fd6-463c-8324-fa5dd4b0873a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:08.844738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:08.845570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:08.845870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:08.846149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:08.857450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:08.865443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 14:39:08.866964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 534/1062] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:08.873971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:08.979376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740129-8a84-4ea4-952a-4c50594e05c6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.015460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.016134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.016415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.016689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.017432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:09.017737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.019138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.027613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 529/1063] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:39:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:09.033235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:09.128322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceee775-4775-485c-8270-a0b804ce1481 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.160597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.161395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.161732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.162051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.172324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.173777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.190026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:09.191312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 535/1064] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:09.196960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:09.291451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957282e-9ffb-477a-abfd-0f8f44a4fca3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.324294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.325449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.325824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.326217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.327021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:09.327424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.328864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.340640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 530/1065] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:09.345983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:09.439519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a915e8-27ad-4046-9a75-82cffa5ac320 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.471360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.472081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.472358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.472629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] PATH_INFO: `/v3/users/nova` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.480259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.481665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.500480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:39:09.501908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 536/1066] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:09.507299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:09.605920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68f6f-5ff0-4e54-a793-e93633a7b6fd None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.641401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.642094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.642372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.642639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.643458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:09.643760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.645195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.661946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 531/1067] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:09.667759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:09.761919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2672ca-ba38-4fa9-875e-9692a4ad74de None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.795402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.796206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.796480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.796745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.808976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.810425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.826820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:09.828192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 537/1068] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:09.833595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:09.928957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc34a4-83c6-4f0e-b049-915af8590d26 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:09.965937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:09.966604 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:09.966887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:09.967161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:09.967879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:09.968184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:09.969547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:09.986374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 532/1069] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:09.987432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:10.084590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44c89-9922-48b3-8e52-dcdde11a038c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:10.117051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:10.117843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:10.118153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:10.118426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:10.125896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:10.127355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:10.141169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:39:10.142503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 538/1070] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:10.148324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:10.245634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897664b-b40a-4c69-9cd1-ad70e50b5d7e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:10.277920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:10.278582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:10.278869 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:10.279147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:10.279920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:10.280231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:10.281696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16642ee-dfed-4f93-811c-c5dc77aa9d21 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:10.294150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 533/1071] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:10.300132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:10.397555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0e39-b203-408d-a516-3e5462892f3e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:10.430849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518dc10-5881-4961-a5f1-2aeaaff8d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:10.431739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518dc10-5881-4961-a5f1-2aeaaff8d556 None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:10.432019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518dc10-5881-4961-a5f1-2aeaaff8d556 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:10.432295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518dc10-5881-4961-a5f1-2aeaaff8d556 None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/54185e0e2c5549f3b397a8009ae27713/roles/06605088e6204e4ab81e5a630b8ba512` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:10.434736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518dc10-5881-4961-a5f1-2aeaaff8d556 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=54185e0e2c5549f3b397a8009ae27713, role_id=06605088e6204e4ab81e5a630b8ba512)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:10.436179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518dc10-5881-4961-a5f1-2aeaaff8d556 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:10.451380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 539/1072] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:39:10 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/54185e0e2c5549f3b397a8009ae27713/roles/06605088e6204e4ab81e5a630b8ba512 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:39:10.969794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d72f0-389e-47b4-af46-fcc77f536ba8 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:10.970327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d72f0-389e-47b4-af46-fcc77f536ba8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:10.970407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d72f0-389e-47b4-af46-fcc77f536ba8 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:10.972274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 534/1073] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:10.977155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e554-da93-4f12-bdcc-0b7cd484beb3 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:10.977445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e554-da93-4f12-bdcc-0b7cd484beb3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:10.977718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e554-da93-4f12-bdcc-0b7cd484beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:10.994217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2e11e554-da93-4f12-bdcc-0b7cd484beb3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:10.996078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2e11e554-da93-4f12-bdcc-0b7cd484beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:11.058541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 540/1074] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:11.080560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d72f0-389e-47b4-af46-fcc77f536ba8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.149074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250fbff-e08b-4503-9f8b-177f6620ddb9 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.149440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250fbff-e08b-4503-9f8b-177f6620ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.149632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250fbff-e08b-4503-9f8b-177f6620ddb9 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.152174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 541/1075] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:39:11.157062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.157351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.157630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.174340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:11.175503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:11.178483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d72f0-389e-47b4-af46-fcc77f536ba8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.211471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.212187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.212466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.212736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.223862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:11.231298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:11.232642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 535/1076] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:11.238201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.242926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 542/1077] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:39:11.265749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.332535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72d81-2eae-4d7a-93e0-b00d3fd9ed72 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.362090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f44d4-f842-4736-852b-13c81144cf8e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.365109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.365771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.366080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.366357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.367088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:11.367391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.368742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.377036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 536/1078] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:11.382717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.395009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.395656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.395957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.396227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.462608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.464656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.478823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b636dbd-7027-45b4-b88a-cf1ac7f55141 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.517632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.518534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.518811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.519082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] PATH_INFO: `/v3/users/45b75d56d4144d69938bfcb49166224d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.520257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=45b75d56d4144d69938bfcb49166224d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.521677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.523292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 537/1079] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/users/45b75d56d4144d69938bfcb49166224d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:11.529037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.561910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 543/1080] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:39:11.566516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.628097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3742206-f736-4c9e-8782-c9bc5a718bb6 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.663721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.664579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.664861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.665138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.666548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] RBAC: Authorizing `identity:get_project(project_id=c782d15d18884ca898787c2d58522ebb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.668361 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.670031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 538/1081] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/projects/c782d15d18884ca898787c2d58522ebb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:11.670657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82817d8b-8841-48a5-8f3d-2a532abfe02b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.675840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.706843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.707643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.707929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.708205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.718679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.720072 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.737039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:11.738249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 544/1082] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:11.744708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:11.781273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e50031-3d31-4fd3-89a1-9d9f79e5f1ae None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.815971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca75100-e3c3-49ac-a83d-9c4e8ff0c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.817160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca75100-e3c3-49ac-a83d-9c4e8ff0c315 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.817681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca75100-e3c3-49ac-a83d-9c4e8ff0c315 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.818222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca75100-e3c3-49ac-a83d-9c4e8ff0c315 None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb/users/45b75d56d4144d69938bfcb49166224d/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.820414 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca75100-e3c3-49ac-a83d-9c4e8ff0c315 None admin] RBAC: Authorizing `identity:create_grant(project_id=c782d15d18884ca898787c2d58522ebb, user_id=45b75d56d4144d69938bfcb49166224d, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.822065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca75100-e3c3-49ac-a83d-9c4e8ff0c315 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.835965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 539/1083] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:39:11 2022] PUT /identity/v3/projects/c782d15d18884ca898787c2d58522ebb/users/45b75d56d4144d69938bfcb49166224d/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:39:11.845191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307708c-09a3-4915-b76b-8baaed72a84b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:11.882498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:11.883182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:11.883468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:11.883740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:11.884474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:11.884786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:11.886876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6992-9570-470b-966b-b927b232f7de None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:11.906152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 545/1084] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:12.764787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24817719-deae-46d2-a2fd-ea829e399c69 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:12.765347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24817719-deae-46d2-a2fd-ea829e399c69 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:12.765457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24817719-deae-46d2-a2fd-ea829e399c69 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:12.767194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 540/1085] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:12.772510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:12.772944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:12.773066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:12.790091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:12.791261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:12.854278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 546/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:12.877908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24817719-deae-46d2-a2fd-ea829e399c69 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:12.981157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24817719-deae-46d2-a2fd-ea829e399c69 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.013508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.014368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.014648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.014970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.025110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:13.033248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 14:39:13.034610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 541/1087] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Mar 8 14:39:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:13.040386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:13.132587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b192f-e11c-44f0-95e1-a22de74f1d27 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.164434 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.165092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.165373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.165646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.166411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:13.166718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:13.168698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:13.176424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 547/1088] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:39:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:13.181833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:13.275023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9423444-e5d7-482a-9f2a-2e2e1b471aad None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.305677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.306503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.306785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.307058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.317688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:13.319136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:13.335684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:13.336968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 542/1089] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:13.342394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:13.435955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b44e00-0e09-4056-ae30-fb06f2a06e5e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.467062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.467713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.467985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.468251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.468963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:13.469261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:13.470782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:13.482874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 548/1090] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:13.488430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:13.585117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd350f4f-2371-446c-9c40-318c83af4534 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.616768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.617560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.617844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.618145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.626672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:13.628103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:13.641621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 14:39:13.642834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 543/1091] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Mar 8 14:39:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:13.648525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:13.742095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a45b36-088f-480f-92a3-2ef720fe6d44 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.774380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.775048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.775328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.775601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.776442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:13.776747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:13.778210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:13.795086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 549/1092] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Mar 8 14:39:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:13.800651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:13.899267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219f820-23a6-4a98-9e4d-cd8c48ae0d88 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:13.932153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242eb95-7222-41ac-a21a-1a8801f4afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:13.932799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242eb95-7222-41ac-a21a-1a8801f4afc9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:13.933235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242eb95-7222-41ac-a21a-1a8801f4afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:13.933518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242eb95-7222-41ac-a21a-1a8801f4afc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:13.997813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242eb95-7222-41ac-a21a-1a8801f4afc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:13.999274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242eb95-7222-41ac-a21a-1a8801f4afc9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.091227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 544/1093] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:39:14.096944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.189917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2504572-e6ed-46b6-ad58-3b9b99979506 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.222290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74930b7-cf61-43b7-b33f-78a88c25bc6e None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.222579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74930b7-cf61-43b7-b33f-78a88c25bc6e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.222822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.222961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74930b7-cf61-43b7-b33f-78a88c25bc6e None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.223618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.223900 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.224175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.224591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 545/1094] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:39:14.229553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.229839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.230152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.234684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.236133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.246157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:14.247334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:14.252475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:39:14.253644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 550/1095] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:14.259283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.309687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 546/1096] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:39:14.333084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.350777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc553d-eea4-40b9-92b3-c1a6570daa7d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.382630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.383281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.383555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.383824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.384527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:14.384832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.386414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.397098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 551/1097] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:14.402548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.425009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c435b-f5b6-4633-ae6d-7cf2595b1106 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.457177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.457941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.458226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.458501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.468287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:14.475229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:14.476380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 547/1098] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:14.483145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.496052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedb077-d400-4f37-b613-af6e631bb156 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.526814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.527619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.527895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.528165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.534455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.535895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.549871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:39:14.551019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 552/1099] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:39:14.556728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.576921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f16306-2ef9-487a-b454-00f275d7530e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.609269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.609953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.610238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.610513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.611248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:14.611556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.612912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.621221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 548/1100] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:14.626833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.650545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680b5b0-f27a-45d5-b777-d17bcb52cb08 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.683248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.683897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.684180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.684453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.685221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:14.685526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.687011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.698011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 553/1101] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:14.704209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.722272 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90555192-20a0-4db0-82cb-ccd6847d744b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.754568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.755432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.755712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.755986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] PATH_INFO: `/v3/users/45b75d56d4144d69938bfcb49166224d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.757170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] RBAC: Authorizing `identity:get_user(user_id=45b75d56d4144d69938bfcb49166224d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.758602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.760315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 549/1102] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/users/45b75d56d4144d69938bfcb49166224d => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:14.766186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:14.797344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c66e9-3905-4870-a5f1-0c83afc9f46e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.829197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.829838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.830147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.830421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.831228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] RBAC: Adding query filter params (role.id=06605088e6204e4ab81e5a630b8ba512, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=54185e0e2c5549f3b397a8009ae27713) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:14.831533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.832953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:14.838440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 554/1103] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/role_assignments?user.id=54185e0e2c5549f3b397a8009ae27713&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=06605088e6204e4ab81e5a630b8ba512 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:14.863201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6a54-eb1e-417e-9ca4-ff56138a0f0b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:14.897525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:14.898368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:14.898530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:14.898810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:14.971536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:14.973050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:15.071640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 550/1104] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:39:15.078506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:15.177145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd94ef-a9c3-47ea-bab0-453e46dbfc7e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:15.209608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b22ef-dbdb-4cd1-a4de-19139db6cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:15.210505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b22ef-dbdb-4cd1-a4de-19139db6cdba None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:15.210781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b22ef-dbdb-4cd1-a4de-19139db6cdba None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:15.211053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b22ef-dbdb-4cd1-a4de-19139db6cdba None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:15.212218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b22ef-dbdb-4cd1-a4de-19139db6cdba None admin] RBAC: Authorizing `identity:get_project(project_id=c782d15d18884ca898787c2d58522ebb)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:15.213711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b22ef-dbdb-4cd1-a4de-19139db6cdba None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:15.215437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 555/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:15 2022] GET /identity/v3/projects/c782d15d18884ca898787c2d58522ebb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:15.221576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:15.320428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b579-deb7-499d-b82b-4684b6f07568 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:15.353603 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:15.354856 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:15.355230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:15.355519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:15.356343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=c782d15d18884ca898787c2d58522ebb, user.id=45b75d56d4144d69938bfcb49166224d) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:15.356663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:15.358146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1364449-8396-4d05-a4db-241a9580bce5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:15.364097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 551/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:15 2022] GET /identity/v3/role_assignments?user.id=45b75d56d4144d69938bfcb49166224d&scope.project.id=c782d15d18884ca898787c2d58522ebb&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:17.685293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e827-a44a-44d1-81cb-2ad6bdbad8c5 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:17.685822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e827-a44a-44d1-81cb-2ad6bdbad8c5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:17.685971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e827-a44a-44d1-81cb-2ad6bdbad8c5 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:17.687678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 556/1107] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:17.693118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:17.693518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:17.693681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:17.710286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:17.711466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:17.773478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 552/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:17.799195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e827-a44a-44d1-81cb-2ad6bdbad8c5 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:17.897393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e827-a44a-44d1-81cb-2ad6bdbad8c5 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:17.929812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43659d-8595-4728-8c8f-87a9bf1f8a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:17.930622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43659d-8595-4728-8c8f-87a9bf1f8a09 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:17.930903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43659d-8595-4728-8c8f-87a9bf1f8a09 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:17.931176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43659d-8595-4728-8c8f-87a9bf1f8a09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:17.932808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43659d-8595-4728-8c8f-87a9bf1f8a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:17.934374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43659d-8595-4728-8c8f-87a9bf1f8a09 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:17.935981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 557/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:17.941585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:18.038630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5b9a-22bc-442e-ae08-ab420e0b40bf None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:18.069688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3e96-abd8-45b9-ba72-ec1fb995df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:18.070378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3e96-abd8-45b9-ba72-ec1fb995df8e None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:18.070661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3e96-abd8-45b9-ba72-ec1fb995df8e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:18.070938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3e96-abd8-45b9-ba72-ec1fb995df8e None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:18.071651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e3e96-abd8-45b9-ba72-ec1fb995df8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:18.073733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e3e96-abd8-45b9-ba72-ec1fb995df8e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:18.093494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 553/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:39:17 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:39:20.403564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cd09-ca7f-47f7-b243-60dcb0876baf None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:20.404126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cd09-ca7f-47f7-b243-60dcb0876baf None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:20.404126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cd09-ca7f-47f7-b243-60dcb0876baf None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:20.405917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 558/1111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:39:20.411040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:20.411456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:20.411596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:20.428842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:20.430056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:20.492707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 554/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:20.517431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cd09-ca7f-47f7-b243-60dcb0876baf None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:20.613132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cd09-ca7f-47f7-b243-60dcb0876baf None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:20.644008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:20.644856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:20.645139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:20.645418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] PATH_INFO: `/v3/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:20.646896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] RBAC: Authorizing `identity:get_role(role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:20.648268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:20.649596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 559/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:20 2022] GET /identity/v3/roles/24213b919d7548379490f689a4ceb95d => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:20.655890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:20.746501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adf9c5-fd6c-4805-89b6-f532a81c8b35 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:20.777475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:20.778497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:20.778779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:20.779054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] PATH_INFO: `/v3/users/1000d97fcb9a4c948127364ebb282feb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:20.791140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] RBAC: Authorizing `identity:get_user(user_id=1000d97fcb9a4c948127364ebb282feb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:20.793502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:20.795114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 555/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:20 2022] GET /identity/v3/users/1000d97fcb9a4c948127364ebb282feb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:20.800792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:20.895780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08266d32-9f2b-4d75-b617-603ce27b39d2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:20.927519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:20.928090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:20.928367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:20.928636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:20.992448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:20.993939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:21.082926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 560/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 14:39:21.088806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:21.181163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d546a-8337-446a-95c1-d4c3f16e8b63 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:21.212841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d489130-382a-4f1d-a87a-fa772b03756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:21.213713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d489130-382a-4f1d-a87a-fa772b03756a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:21.214029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d489130-382a-4f1d-a87a-fa772b03756a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:21.214306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d489130-382a-4f1d-a87a-fa772b03756a None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:21.215474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d489130-382a-4f1d-a87a-fa772b03756a None admin] RBAC: Authorizing `identity:get_project(project_id=c782d15d18884ca898787c2d58522ebb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:21.216884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d489130-382a-4f1d-a87a-fa772b03756a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:21.218541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 556/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:21 2022] GET /identity/v3/projects/c782d15d18884ca898787c2d58522ebb => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:21.224585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:21.318562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996adf3-5562-4a2c-bbcc-1ff652f82a60 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:21.349942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:21.350582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:21.350856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:21.351127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:21.351933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] RBAC: Adding query filter params (role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=c782d15d18884ca898787c2d58522ebb, user.id=1000d97fcb9a4c948127364ebb282feb) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:21.352241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:21.353663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbbe66-41fc-4adc-a029-12727a1546ec None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:21.359345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 561/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:21 2022] GET /identity/v3/role_assignments?user.id=1000d97fcb9a4c948127364ebb282feb&scope.project.id=c782d15d18884ca898787c2d58522ebb&role.id=24213b919d7548379490f689a4ceb95d => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:23.677537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf65dca-7e3e-472f-b725-2c53f31ba18a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:23.678092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf65dca-7e3e-472f-b725-2c53f31ba18a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:23.678205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf65dca-7e3e-472f-b725-2c53f31ba18a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:23.679870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 557/1118] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:23.686033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:23.686447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:23.686577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:23.704552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:23.705731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:23.767176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 562/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:23.789731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf65dca-7e3e-472f-b725-2c53f31ba18a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:23.885766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf65dca-7e3e-472f-b725-2c53f31ba18a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:23.917383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:23.918253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:23.918546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:23.918824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] PATH_INFO: `/v3/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:23.920287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] RBAC: Authorizing `identity:get_role(role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:23.921645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:23.922991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 558/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:23 2022] GET /identity/v3/roles/24213b919d7548379490f689a4ceb95d => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:23.928666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:24.020537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751b981-f2ba-4776-9b5a-d3ce4be8ae95 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:24.051643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:24.052500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:24.052781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:24.053054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] PATH_INFO: `/v3/users/1000d97fcb9a4c948127364ebb282feb` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:24.054249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] RBAC: Authorizing `identity:get_user(user_id=1000d97fcb9a4c948127364ebb282feb)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:24.055682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:24.057949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 563/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:23 2022] GET /identity/v3/users/1000d97fcb9a4c948127364ebb282feb => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:24.063634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:24.155940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049749f-e49b-41e0-ad91-50bc0509132a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:24.188547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41dd16-6441-463c-bd51-cb78d7b1c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:24.189321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41dd16-6441-463c-bd51-cb78d7b1c351 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:24.189599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41dd16-6441-463c-bd51-cb78d7b1c351 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:24.189892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41dd16-6441-463c-bd51-cb78d7b1c351 None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:24.191036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41dd16-6441-463c-bd51-cb78d7b1c351 None admin] RBAC: Authorizing `identity:get_project(project_id=c782d15d18884ca898787c2d58522ebb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:24.192439 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41dd16-6441-463c-bd51-cb78d7b1c351 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:24.194081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 559/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:24 2022] GET /identity/v3/projects/c782d15d18884ca898787c2d58522ebb => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:24.199976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:24.291752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497e13-a7ae-481d-936c-25c2401853b8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:24.323618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43673667-b950-4e5d-a585-2a1c132ced3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:24.324480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43673667-b950-4e5d-a585-2a1c132ced3a None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:24.325025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43673667-b950-4e5d-a585-2a1c132ced3a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:24.325297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43673667-b950-4e5d-a585-2a1c132ced3a None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb/users/1000d97fcb9a4c948127364ebb282feb/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:24.327475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43673667-b950-4e5d-a585-2a1c132ced3a None admin] RBAC: Authorizing `identity:create_grant(project_id=c782d15d18884ca898787c2d58522ebb, user_id=1000d97fcb9a4c948127364ebb282feb, role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:24.328920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43673667-b950-4e5d-a585-2a1c132ced3a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:24.341784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 564/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:39:24 2022] PUT /identity/v3/projects/c782d15d18884ca898787c2d58522ebb/users/1000d97fcb9a4c948127364ebb282feb/roles/24213b919d7548379490f689a4ceb95d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:39:26.670053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237595e-e057-4229-bd5d-9e8baec9eeed None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:26.670583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237595e-e057-4229-bd5d-9e8baec9eeed None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:26.670583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237595e-e057-4229-bd5d-9e8baec9eeed None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:26.672347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 560/1124] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:26.677668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:26.678069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:26.678246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:26.694503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:26.695659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:26.757861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 565/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:26.782483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237595e-e057-4229-bd5d-9e8baec9eeed None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:26.879315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237595e-e057-4229-bd5d-9e8baec9eeed None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:26.911488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:26.912325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:26.912606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:26.912877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] PATH_INFO: `/v3/roles/24213b919d7548379490f689a4ceb95d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:26.914336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] RBAC: Authorizing `identity:get_role(role_id=24213b919d7548379490f689a4ceb95d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:26.915685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:26.917616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 561/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:26 2022] GET /identity/v3/roles/24213b919d7548379490f689a4ceb95d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:26.923389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:27.016801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643faf-a6f2-4883-9f45-67eb2b49c214 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:27.047676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:27.048538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:27.048818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:27.049090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] PATH_INFO: `/v3/users/1000d97fcb9a4c948127364ebb282feb` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:27.050276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=1000d97fcb9a4c948127364ebb282feb)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:27.051703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:27.053308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 566/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:26 2022] GET /identity/v3/users/1000d97fcb9a4c948127364ebb282feb => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:27.059666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:27.154641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5adba-7dcc-4fc5-9075-d882b8b63aeb None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:27.186104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:27.186678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:27.186963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:27.187236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:27.249838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:27.251290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:27.341687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 562/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:39:27.347584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:27.440893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f833023-19b4-4b5e-ab13-a96f22dd3ab4 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:27.472871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c09072-9d89-42e9-b2dc-2a00ee6dc5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:27.473722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c09072-9d89-42e9-b2dc-2a00ee6dc5ab None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:27.474036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c09072-9d89-42e9-b2dc-2a00ee6dc5ab None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:27.474343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c09072-9d89-42e9-b2dc-2a00ee6dc5ab None admin] PATH_INFO: `/v3/projects/c782d15d18884ca898787c2d58522ebb` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:27.475515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c09072-9d89-42e9-b2dc-2a00ee6dc5ab None admin] RBAC: Authorizing `identity:get_project(project_id=c782d15d18884ca898787c2d58522ebb)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:27.476952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c09072-9d89-42e9-b2dc-2a00ee6dc5ab None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:27.478650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 567/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:27 2022] GET /identity/v3/projects/c782d15d18884ca898787c2d58522ebb => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:27.484687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:27.578065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d75b-df79-4860-b5d5-f888b50d632a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:27.612531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:27.613179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:27.613464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:27.613747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:27.614595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] RBAC: Adding query filter params (role.id=24213b919d7548379490f689a4ceb95d, scope.project.id=c782d15d18884ca898787c2d58522ebb, user.id=1000d97fcb9a4c948127364ebb282feb) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:27.614907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:27.616333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2ad70-110c-46c9-9e32-4a1ac9d386b2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:27.622742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 563/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:27 2022] GET /identity/v3/role_assignments?user.id=1000d97fcb9a4c948127364ebb282feb&scope.project.id=c782d15d18884ca898787c2d58522ebb&role.id=24213b919d7548379490f689a4ceb95d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:29.913426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da35fc-eb98-44f0-b6d0-9ad0d20c0c04 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:29.914109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da35fc-eb98-44f0-b6d0-9ad0d20c0c04 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:29.914109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da35fc-eb98-44f0-b6d0-9ad0d20c0c04 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:29.915779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 568/1131] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:29.920985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:29.921389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:29.921576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:29.937840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:29.939223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:30.002104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 564/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:30.025407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da35fc-eb98-44f0-b6d0-9ad0d20c0c04 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:30.118954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da35fc-eb98-44f0-b6d0-9ad0d20c0c04 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:30.149380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937892ed-f4fe-496b-b07c-0948289ed839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:30.150180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937892ed-f4fe-496b-b07c-0948289ed839 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:30.150455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937892ed-f4fe-496b-b07c-0948289ed839 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:30.150767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937892ed-f4fe-496b-b07c-0948289ed839 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:30.151918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937892ed-f4fe-496b-b07c-0948289ed839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:30.153348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937892ed-f4fe-496b-b07c-0948289ed839 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:30.154925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 569/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:30.160416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:30.252556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f40c15-e294-4c62-a2cd-5ad7c35af77c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:30.283729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591776-9138-4279-980f-306b237b4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:30.284371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591776-9138-4279-980f-306b237b4aa6 None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:30.284655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591776-9138-4279-980f-306b237b4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:30.284930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591776-9138-4279-980f-306b237b4aa6 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:30.285630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04591776-9138-4279-980f-306b237b4aa6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:30.287067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04591776-9138-4279-980f-306b237b4aa6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:30.311367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 565/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:39:30 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:32.627256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ec94-e34b-42cc-91a4-6854c9245c9d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:32.627821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ec94-e34b-42cc-91a4-6854c9245c9d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:32.627821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ec94-e34b-42cc-91a4-6854c9245c9d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:32.629593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 570/1135] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:32.634786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:32.635184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:32.635875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:32.652187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:32.653358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:32.715046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 566/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:32.739909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ec94-e34b-42cc-91a4-6854c9245c9d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:32.838763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ec94-e34b-42cc-91a4-6854c9245c9d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:32.870561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c611-b210-4cfc-a927-d0bd51fa41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:32.871347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c611-b210-4cfc-a927-d0bd51fa41bd None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:32.871629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c611-b210-4cfc-a927-d0bd51fa41bd None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:32.871904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c611-b210-4cfc-a927-d0bd51fa41bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:32.873067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c611-b210-4cfc-a927-d0bd51fa41bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:32.874546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c611-b210-4cfc-a927-d0bd51fa41bd None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:32.876169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 571/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:39:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:32.881913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:32.975713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8853fc-447f-4bbe-989f-fef669aab1ea None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:33.006752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8af27-dd26-4be6-adb0-026680abda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:33.007403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8af27-dd26-4be6-adb0-026680abda7b None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:33.007684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8af27-dd26-4be6-adb0-026680abda7b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:33.007957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8af27-dd26-4be6-adb0-026680abda7b None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:33.008646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8af27-dd26-4be6-adb0-026680abda7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:33.010660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8af27-dd26-4be6-adb0-026680abda7b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:33.030220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 567/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:39:32 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:35.324300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f231b5-1fe2-4a31-8c30-9061290b13b9 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:35.325076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f231b5-1fe2-4a31-8c30-9061290b13b9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:35.325076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f231b5-1fe2-4a31-8c30-9061290b13b9 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:35.326897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 572/1139] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:35.332182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:35.332603 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:35.332745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:35.349051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:35.350265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:35.411838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 568/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:35.436927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f231b5-1fe2-4a31-8c30-9061290b13b9 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:35.529695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f231b5-1fe2-4a31-8c30-9061290b13b9 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:35.560808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:35.561587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:35.561886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:35.562162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:35.572693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:35.580074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:35.581152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 573/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:35.587140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:35.683784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162bbcf-a15e-48c4-9c64-16824a033c1a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:35.715605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:35.716247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:35.716527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:35.716800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:35.717527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:35.717828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:35.719449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:35.731632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 569/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:35.737384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:35.832519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8258-b3fa-4d15-9dad-f77c1dcd6925 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:35.865323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:35.866208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:35.866487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:35.866758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] PATH_INFO: `/v3/users/f88ee0b75cc14eda8a46e89bc03ceab1` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:35.879346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] RBAC: Authorizing `identity:get_user(user_id=f88ee0b75cc14eda8a46e89bc03ceab1)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:35.880810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:35.882440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 574/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:35 2022] GET /identity/v3/users/f88ee0b75cc14eda8a46e89bc03ceab1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:35.888184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:35.984371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145936-bd0d-40e1-99d8-cae136e8e724 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:36.015465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:36.016097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:36.016376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:36.016649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:36.078642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:36.080054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:36.172189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 570/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:39:36.178053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:36.270642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff9ae8-fc1f-46d2-bccf-75caeda9cedb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:36.301671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edfb65-a98f-4101-895c-a94d3b5753a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:36.302535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edfb65-a98f-4101-895c-a94d3b5753a1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:36.302815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edfb65-a98f-4101-895c-a94d3b5753a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:36.303086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edfb65-a98f-4101-895c-a94d3b5753a1 None admin] PATH_INFO: `/v3/projects/abf611d3c5e34c0c84a134a1c520c323` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:36.304229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edfb65-a98f-4101-895c-a94d3b5753a1 None admin] RBAC: Authorizing `identity:get_project(project_id=abf611d3c5e34c0c84a134a1c520c323)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:36.305657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edfb65-a98f-4101-895c-a94d3b5753a1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:36.308259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 575/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:36 2022] GET /identity/v3/projects/abf611d3c5e34c0c84a134a1c520c323 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:39:36.314352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:36.406913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c7e0e-b87c-4fda-804c-bb4e61f1256b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:36.438936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:36.439518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:36.439801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:36.440078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:36.440884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=abf611d3c5e34c0c84a134a1c520c323, user.id=f88ee0b75cc14eda8a46e89bc03ceab1) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:36.441196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:36.442638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f3f8-6bc1-4748-83ac-951d781165cd None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:36.448289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 571/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:36 2022] GET /identity/v3/role_assignments?user.id=f88ee0b75cc14eda8a46e89bc03ceab1&scope.project.id=abf611d3c5e34c0c84a134a1c520c323&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:38.733992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798ad6-7ac9-4538-b8a6-dadad01613c6 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:38.734617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798ad6-7ac9-4538-b8a6-dadad01613c6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:38.734617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798ad6-7ac9-4538-b8a6-dadad01613c6 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:38.736327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 576/1147] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:38.741507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:38.741980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:38.742083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:38.758714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:38.760451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:38.822982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 572/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:38.845590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798ad6-7ac9-4538-b8a6-dadad01613c6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:38.941603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798ad6-7ac9-4538-b8a6-dadad01613c6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:38.973340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:38.974159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:38.974436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:38.974705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:38.984659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:38.991649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:38.992793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 577/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:38.999773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:39.092063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781bc5d-678b-4293-9c0e-0df277215615 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:39.123887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:39.124539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:39.124822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:39.125098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:39.125827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:39.126162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:39.127513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:39.135093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 573/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:39.140719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:39.232560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7a0df-5339-41ef-a659-111a330fbf23 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:39.264316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:39.265106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:39.265382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:39.265650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] PATH_INFO: `/v3/users/f88ee0b75cc14eda8a46e89bc03ceab1` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:39.266826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=f88ee0b75cc14eda8a46e89bc03ceab1)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:39.268251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:39.269804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 578/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:39 2022] GET /identity/v3/users/f88ee0b75cc14eda8a46e89bc03ceab1 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:39.275431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:39.368245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1e21-8f3e-4699-944a-b30dba5e590b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:39.398970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50159245-eeb9-4549-ac18-df5495a54834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:39.399813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159245-eeb9-4549-ac18-df5495a54834 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:39.400096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159245-eeb9-4549-ac18-df5495a54834 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:39.400913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159245-eeb9-4549-ac18-df5495a54834 None admin] PATH_INFO: `/v3/projects/abf611d3c5e34c0c84a134a1c520c323` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:39.402098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50159245-eeb9-4549-ac18-df5495a54834 None admin] RBAC: Authorizing `identity:get_project(project_id=abf611d3c5e34c0c84a134a1c520c323)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:39.403512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50159245-eeb9-4549-ac18-df5495a54834 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:39.405130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 574/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:39 2022] GET /identity/v3/projects/abf611d3c5e34c0c84a134a1c520c323 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:39.410750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:39.502558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040481-ee5d-437b-9cb4-ecb125e4b8d2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:39.533370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a62c-f759-4a53-895d-eb5db1a29bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:39.534210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a62c-f759-4a53-895d-eb5db1a29bed None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:39.534486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a62c-f759-4a53-895d-eb5db1a29bed None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:39.534752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a62c-f759-4a53-895d-eb5db1a29bed None admin] PATH_INFO: `/v3/projects/abf611d3c5e34c0c84a134a1c520c323/users/f88ee0b75cc14eda8a46e89bc03ceab1/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:39.536658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7a62c-f759-4a53-895d-eb5db1a29bed None admin] RBAC: Authorizing `identity:create_grant(project_id=abf611d3c5e34c0c84a134a1c520c323, user_id=f88ee0b75cc14eda8a46e89bc03ceab1, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:39.538105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7a62c-f759-4a53-895d-eb5db1a29bed None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:39.550968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 579/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:39:39 2022] PUT /identity/v3/projects/abf611d3c5e34c0c84a134a1c520c323/users/f88ee0b75cc14eda8a46e89bc03ceab1/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:39:41.820092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685011c-1363-44ee-8305-2600ab3fb6e1 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:41.820656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685011c-1363-44ee-8305-2600ab3fb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:41.820656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685011c-1363-44ee-8305-2600ab3fb6e1 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:41.823120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 575/1154] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:41.828654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:41.829065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:41.829201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:41.846601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:41.847763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:42.036916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 580/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:42.061567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685011c-1363-44ee-8305-2600ab3fb6e1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:42.157894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685011c-1363-44ee-8305-2600ab3fb6e1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:42.189072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:42.189880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:42.190169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:42.190445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:42.201262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:42.208416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:42.209546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 576/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:42.216334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:42.307475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ef84-491a-49de-81a6-7b01a4f63c1e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:42.338528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:42.339172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:42.339449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:42.339719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:42.340445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:42.340748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:42.342139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:42.349604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 581/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:42.356069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:42.447219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e56fb-a902-4085-aada-ecc5de9da6c2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:42.479208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:42.480092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:42.480368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:42.480638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] PATH_INFO: `/v3/users/f88ee0b75cc14eda8a46e89bc03ceab1` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:42.481787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] RBAC: Authorizing `identity:get_user(user_id=f88ee0b75cc14eda8a46e89bc03ceab1)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:42.483224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:42.484762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 577/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:42 2022] GET /identity/v3/users/f88ee0b75cc14eda8a46e89bc03ceab1 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:42.490311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:42.582063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d47a8-796b-4f62-8919-8765a1e61c9b None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:42.613749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:42.614396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:42.614678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:42.614952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:42.676916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:42.678372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:42.769101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 582/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:39:42.774782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:42.867175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e82a4-9e88-47fd-b7e2-2b9279e65edc None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:42.898502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8ead-6faa-4618-be16-bf9d8c3398e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:42.899336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8ead-6faa-4618-be16-bf9d8c3398e8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:42.899608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8ead-6faa-4618-be16-bf9d8c3398e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:42.899874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8ead-6faa-4618-be16-bf9d8c3398e8 None admin] PATH_INFO: `/v3/projects/abf611d3c5e34c0c84a134a1c520c323` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:42.901045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8ead-6faa-4618-be16-bf9d8c3398e8 None admin] RBAC: Authorizing `identity:get_project(project_id=abf611d3c5e34c0c84a134a1c520c323)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:42.902474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8ead-6faa-4618-be16-bf9d8c3398e8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:42.904085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 578/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:42 2022] GET /identity/v3/projects/abf611d3c5e34c0c84a134a1c520c323 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:42.910062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:43.003309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8287-b672-4224-a8a4-004f76e4ec01 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:43.034718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:43.035306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:43.035592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:43.035868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:43.036676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=abf611d3c5e34c0c84a134a1c520c323, user.id=f88ee0b75cc14eda8a46e89bc03ceab1) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:43.036985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:43.038453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8ebc-f807-44b0-816f-ee36bfeb96c7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:43.044495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 583/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:42 2022] GET /identity/v3/role_assignments?user.id=f88ee0b75cc14eda8a46e89bc03ceab1&scope.project.id=abf611d3c5e34c0c84a134a1c520c323&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:45.380341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef1d3-9a2d-4dec-9966-d157147ae613 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:45.380896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef1d3-9a2d-4dec-9966-d157147ae613 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:45.380896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef1d3-9a2d-4dec-9966-d157147ae613 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:45.382725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 579/1162] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:45.388019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:45.388420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:45.388579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:45.405389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:45.406598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:45.468876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 584/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:45.491768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef1d3-9a2d-4dec-9966-d157147ae613 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:45.584523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef1d3-9a2d-4dec-9966-d157147ae613 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:45.616510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:45.617133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:45.617412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:45.617682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:45.678636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:45.679993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:45.770919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 580/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:39:45.777475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:45.868677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad4bdb-c4c2-421a-b24d-3bc77f9bb647 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:45.900842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:45.901636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:45.901939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:45.902215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:45.908560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:45.910042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:45.922970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-5847926b-0db5-45d7-954d-c62ade5190f8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 08 14:39:45.924099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 585/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:39:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:45.930186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:46.022978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cca45-a3c1-4786-907e-00fa498b20a1 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:46.055150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:46.055791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:46.056072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:46.056872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:46.057573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:46.057890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:46.059238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580cea5-7dae-47b9-902c-0030d27bfcf6 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:46.065950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 581/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Mar 8 14:39:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:48.354369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceae56-e0ef-4d43-80b7-e06700d6f87f None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:48.354923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceae56-e0ef-4d43-80b7-e06700d6f87f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:48.354923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceae56-e0ef-4d43-80b7-e06700d6f87f None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:48.356671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 586/1167] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:48.362173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3060c-a713-40e5-a23e-8dd0b01034f4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:48.362589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3060c-a713-40e5-a23e-8dd0b01034f4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:48.362730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3060c-a713-40e5-a23e-8dd0b01034f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:48.379388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-17a3060c-a713-40e5-a23e-8dd0b01034f4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:48.380542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-17a3060c-a713-40e5-a23e-8dd0b01034f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:48.444354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 582/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:48.468134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceae56-e0ef-4d43-80b7-e06700d6f87f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:48.562145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceae56-e0ef-4d43-80b7-e06700d6f87f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:48.592822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493894-56b4-4741-923d-68034fcc6e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:48.593460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493894-56b4-4741-923d-68034fcc6e82 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:48.593739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493894-56b4-4741-923d-68034fcc6e82 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:48.594041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493894-56b4-4741-923d-68034fcc6e82 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:48.594762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d493894-56b4-4741-923d-68034fcc6e82 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:48.596115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d493894-56b4-4741-923d-68034fcc6e82 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:48.610152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 587/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Mar 8 14:39:48 2022] POST /identity/v3/domains => generated 267 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:50.916551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385247f-59b7-4cb2-a9b7-4dafb09bfdb8 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:50.917132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385247f-59b7-4cb2-a9b7-4dafb09bfdb8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:50.917132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385247f-59b7-4cb2-a9b7-4dafb09bfdb8 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:50.918894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 583/1170] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:50.924371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:50.924761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:50.924953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:50.942650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:50.943830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:51.006673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 588/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:51.030628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385247f-59b7-4cb2-a9b7-4dafb09bfdb8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:51.124184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385247f-59b7-4cb2-a9b7-4dafb09bfdb8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:51.155935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6e4bd-9934-4c6b-9490-b500c93e5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:51.156764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6e4bd-9934-4c6b-9490-b500c93e5245 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:51.157041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6e4bd-9934-4c6b-9490-b500c93e5245 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:51.157312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6e4bd-9934-4c6b-9490-b500c93e5245 None admin] PATH_INFO: `/v3/domains/55927b8db29148d883ebe1955168c704` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:51.167344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6e4bd-9934-4c6b-9490-b500c93e5245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=55927b8db29148d883ebe1955168c704)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:51.168749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6e4bd-9934-4c6b-9490-b500c93e5245 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:51.170370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 584/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Mar 8 14:39:51 2022] GET /identity/v3/domains/55927b8db29148d883ebe1955168c704 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:51.176137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:51.270806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64831e-983a-4618-a133-03679620f8a4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:51.302958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ebf1b-5057-4de5-902c-400f4cc303a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:51.303602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ebf1b-5057-4de5-902c-400f4cc303a6 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:51.303886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ebf1b-5057-4de5-902c-400f4cc303a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:51.304157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ebf1b-5057-4de5-902c-400f4cc303a6 None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:51.304855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ebf1b-5057-4de5-902c-400f4cc303a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:51.307331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ebf1b-5057-4de5-902c-400f4cc303a6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:51.331510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 589/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:39:51 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:39:53.633346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a389d3-8b7b-40d0-8811-d1dd186dca1c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:53.633947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a389d3-8b7b-40d0-8811-d1dd186dca1c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:53.633947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a389d3-8b7b-40d0-8811-d1dd186dca1c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:53.635667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 585/1174] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:53.640952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:53.641320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:53.641503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:53.658284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:53.659440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:53.721575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 590/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:53.746821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a389d3-8b7b-40d0-8811-d1dd186dca1c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:53.842859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a389d3-8b7b-40d0-8811-d1dd186dca1c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:53.874397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5e3f-15c5-4661-97be-da5a85ea92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:53.875243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5e3f-15c5-4661-97be-da5a85ea92de None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:53.875523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5e3f-15c5-4661-97be-da5a85ea92de None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:53.875797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5e3f-15c5-4661-97be-da5a85ea92de None admin] PATH_INFO: `/v3/domains/55927b8db29148d883ebe1955168c704` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:53.876955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5e3f-15c5-4661-97be-da5a85ea92de None admin] RBAC: Authorizing `identity:get_domain(domain_id=55927b8db29148d883ebe1955168c704)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:53.878410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5e3f-15c5-4661-97be-da5a85ea92de None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:53.879970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 586/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Mar 8 14:39:53 2022] GET /identity/v3/domains/55927b8db29148d883ebe1955168c704 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:53.885785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:53.977366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14d95-72fa-419b-ad65-40b4a2381467 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:54.008653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9421-8a2d-45d1-9c4c-83b0a0d95b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:54.010015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9421-8a2d-45d1-9c4c-83b0a0d95b98 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:54.010295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9421-8a2d-45d1-9c4c-83b0a0d95b98 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:54.010565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9421-8a2d-45d1-9c4c-83b0a0d95b98 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:54.011262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9421-8a2d-45d1-9c4c-83b0a0d95b98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:54.012712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9421-8a2d-45d1-9c4c-83b0a0d95b98 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:54.032024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 591/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:39:53 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:39:56.342542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19acc-2a39-4e22-8bf3-b476f5416af3 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:56.343094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19acc-2a39-4e22-8bf3-b476f5416af3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:56.343094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19acc-2a39-4e22-8bf3-b476f5416af3 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:56.344835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 587/1178] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:56.350004 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:56.350397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:56.350562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:56.367034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:56.368221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:56.430047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 592/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:56.453675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19acc-2a39-4e22-8bf3-b476f5416af3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:56.547725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19acc-2a39-4e22-8bf3-b476f5416af3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:56.580079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:56.580851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:56.581129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:56.581401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:56.590952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:56.597983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:56.599056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 588/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:56.605174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:56.695702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60f3d4-eba5-44b7-8855-ad04c7dc1fde None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:56.726734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:56.727381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:56.727730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:56.728006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:56.728724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:56.729021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:56.730415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:56.737837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 593/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:56.744043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:56.840521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f217ee8-2a66-497b-9ad9-894868063af9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:56.871848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:56.872643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:56.872927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:56.873205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] PATH_INFO: `/v3/users/270a76c25f34418cb0c553d86c950187` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:56.886933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] RBAC: Authorizing `identity:get_user(user_id=270a76c25f34418cb0c553d86c950187)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:56.888362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:56.889967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 589/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:39:56 2022] GET /identity/v3/users/270a76c25f34418cb0c553d86c950187 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:56.895643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:56.990989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd62c3-cc24-4113-82e9-859b24457d98 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:57.021501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:57.022156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:57.022433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:57.022700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:57.084176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:57.085610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:57.174421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 594/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:39:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:39:57.180155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:57.272292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56284431-7360-4347-a5b2-f9a85c7efa54 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:57.303821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6674da5-731a-4ce2-bd36-5800efb5be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:57.304660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6674da5-731a-4ce2-bd36-5800efb5be9b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:57.304935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6674da5-731a-4ce2-bd36-5800efb5be9b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:57.305202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6674da5-731a-4ce2-bd36-5800efb5be9b None admin] PATH_INFO: `/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:57.307052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6674da5-731a-4ce2-bd36-5800efb5be9b None admin] RBAC: Authorizing `identity:get_project(project_id=bfb81d6fb2f746f6af1b0bec72eccad5)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:57.309358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6674da5-731a-4ce2-bd36-5800efb5be9b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:57.311565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 590/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:39:57 2022] GET /identity/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:57.317636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:57.407821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae1dba-ba1b-4e61-a875-61531fd48ad2 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:57.438806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:57.439377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:57.439654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:57.439924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:57.440720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=bfb81d6fb2f746f6af1b0bec72eccad5, user.id=270a76c25f34418cb0c553d86c950187) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:39:57.441026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:39:57.442473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e5ace-5756-4478-b3cf-16b5c4571236 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:39:57.447675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 595/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:39:57 2022] GET /identity/v3/role_assignments?user.id=270a76c25f34418cb0c553d86c950187&scope.project.id=bfb81d6fb2f746f6af1b0bec72eccad5&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:39:59.702427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b1144-0fe0-4107-9201-6829d21aff71 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:59.702956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b1144-0fe0-4107-9201-6829d21aff71 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:59.703068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b1144-0fe0-4107-9201-6829d21aff71 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:59.704736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 591/1186] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:39:59.709874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:59.710255 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:59.710428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:59.728666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:39:59.729840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:39:59.791432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 596/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:39:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:39:59.814261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b1144-0fe0-4107-9201-6829d21aff71 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:39:59.912536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b1144-0fe0-4107-9201-6829d21aff71 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:39:59.944767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:39:59.945559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:39:59.945841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:39:59.946146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:39:59.956755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:39:59.964379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:39:59.965542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 592/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:39:59.971443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:00.061487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b995-e76d-4d3c-b42f-01519cbe60de None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:00.093311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:00.093985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:00.094268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:00.094535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:00.095261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:40:00.095561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:00.096909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:00.104509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 597/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:40:00.110138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:00.204992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f37d-61c6-415d-80f9-f50b77366579 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:00.236927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:00.237779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:00.238088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:00.238363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] PATH_INFO: `/v3/users/270a76c25f34418cb0c553d86c950187` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:00.239523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] RBAC: Authorizing `identity:get_user(user_id=270a76c25f34418cb0c553d86c950187)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:00.240937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:00.242526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 593/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:40:00 2022] GET /identity/v3/users/270a76c25f34418cb0c553d86c950187 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:40:00.248505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:00.342351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163d876-8b00-490d-830a-bb1ffa87dfb9 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:00.372776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436bd0-a337-4d49-ba9d-dff49991c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:00.373609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436bd0-a337-4d49-ba9d-dff49991c4be None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:00.373907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436bd0-a337-4d49-ba9d-dff49991c4be None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:00.374179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436bd0-a337-4d49-ba9d-dff49991c4be None admin] PATH_INFO: `/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:00.375321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436bd0-a337-4d49-ba9d-dff49991c4be None admin] RBAC: Authorizing `identity:get_project(project_id=bfb81d6fb2f746f6af1b0bec72eccad5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:00.376738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436bd0-a337-4d49-ba9d-dff49991c4be None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:00.378380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 598/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:40:00 2022] GET /identity/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:40:00.384556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:00.476274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abda5ea-94ac-4214-862b-7aa177f0a6b9 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:00.507240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b7e53-5d9d-465a-b660-b838e1c45397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:00.508059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7e53-5d9d-465a-b660-b838e1c45397 None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:00.508336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7e53-5d9d-465a-b660-b838e1c45397 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:00.508605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b7e53-5d9d-465a-b660-b838e1c45397 None admin] PATH_INFO: `/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5/users/270a76c25f34418cb0c553d86c950187/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:00.511124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b7e53-5d9d-465a-b660-b838e1c45397 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfb81d6fb2f746f6af1b0bec72eccad5, user_id=270a76c25f34418cb0c553d86c950187, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:00.512527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b7e53-5d9d-465a-b660-b838e1c45397 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:00.524976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 594/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:40:00 2022] PUT /identity/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5/users/270a76c25f34418cb0c553d86c950187/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:40:02.783679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412779-2bcd-49a4-a02b-4da6744cc62e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:02.784208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412779-2bcd-49a4-a02b-4da6744cc62e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:02.784208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412779-2bcd-49a4-a02b-4da6744cc62e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:02.786037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 599/1193] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:40:02.792056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:02.792461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:02.792628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:02.809020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:40:02.810239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:40:02.874746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 595/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:40:02.898079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412779-2bcd-49a4-a02b-4da6744cc62e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:02.993500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412779-2bcd-49a4-a02b-4da6744cc62e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:03.023936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:03.025549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:03.025828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:03.026133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:03.035937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:40:03.043083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:40:03.044228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 600/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:40:03.050511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:03.140990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515c0d8-f1d4-4722-9a26-a03d42273136 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:03.173089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:03.173732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:03.174036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:03.174310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:03.175027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:40:03.175328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:03.176665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:03.184345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 596/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:40:03.189960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:03.283457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd90552-5669-4cdd-baae-c8005fdb58e0 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:03.316221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:03.317017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:03.317298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:03.317571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] PATH_INFO: `/v3/users/270a76c25f34418cb0c553d86c950187` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:03.318766 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=270a76c25f34418cb0c553d86c950187)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:03.320208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:03.322594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 601/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Mar 8 14:40:03 2022] GET /identity/v3/users/270a76c25f34418cb0c553d86c950187 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:40:03.328372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:03.419831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8001658-4a05-48fb-9d71-566af12b7b80 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:03.451819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:03.452442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:03.452721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:03.452990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:03.514211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:03.515630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:03.606879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 597/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:40:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:40:03.612671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:03.707400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b581e-492b-4f6b-939b-98b2473da3a8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:03.739537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2eeb-869f-4b60-adc3-ac399e455d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:03.740366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2eeb-869f-4b60-adc3-ac399e455d19 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:03.740639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2eeb-869f-4b60-adc3-ac399e455d19 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:03.740907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2eeb-869f-4b60-adc3-ac399e455d19 None admin] PATH_INFO: `/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:03.742063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2eeb-869f-4b60-adc3-ac399e455d19 None admin] RBAC: Authorizing `identity:get_project(project_id=bfb81d6fb2f746f6af1b0bec72eccad5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:03.743503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2eeb-869f-4b60-adc3-ac399e455d19 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:03.745104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 602/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Mar 8 14:40:03 2022] GET /identity/v3/projects/bfb81d6fb2f746f6af1b0bec72eccad5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:40:03.750918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:40:03.847303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7da4-2cce-4038-8aac-8f34f8e55711 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:40:03.882378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:40:03.882957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:40:03.883234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:40:03.884026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:40:03.884837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=bfb81d6fb2f746f6af1b0bec72eccad5, user.id=270a76c25f34418cb0c553d86c950187) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:40:03.885141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:40:03.886571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810900e7-8b39-4681-a43b-248931c6ecd1 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:40:03.892007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 598/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:40:03 2022] GET /identity/v3/role_assignments?user.id=270a76c25f34418cb0c553d86c950187&scope.project.id=bfb81d6fb2f746f6af1b0bec72eccad5&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:06.005583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a96a8-84db-42d0-b0ee-f332f5f52b7f None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:06.006706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a96a8-84db-42d0-b0ee-f332f5f52b7f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:06.006706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a96a8-84db-42d0-b0ee-f332f5f52b7f None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:06.008751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 603/1201] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:06.014441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:06.014910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:06.014998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:06.034882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:06.036183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:06.112542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 599/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:06.140923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a96a8-84db-42d0-b0ee-f332f5f52b7f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:06.265151 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a96a8-84db-42d0-b0ee-f332f5f52b7f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:06.311934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:06.312774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:06.314101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:06.314422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:06.325871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:06.327494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:06.345543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:06.349936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 604/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:06.353878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:06.464109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1c590-38ba-4637-85e6-72a98f16a9b5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:06.505753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:06.505753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:06.505753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:06.505753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:06.506446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:06.506446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:06.507276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362365b-0986-4383-87d7-057f6a63db89 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:06.519671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 600/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:06.526417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:06.639728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aad91-627c-4a8b-ab68-9b69bc264280 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:06.677647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffffb8d-e351-43c2-8bef-1d1285354009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:06.681893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffb8d-e351-43c2-8bef-1d1285354009 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:06.681893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffb8d-e351-43c2-8bef-1d1285354009 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:06.681893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffb8d-e351-43c2-8bef-1d1285354009 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:06.681893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffffb8d-e351-43c2-8bef-1d1285354009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:06.681893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffffb8d-e351-43c2-8bef-1d1285354009 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:06.711628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 605/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Mar 8 14:41:06 2022] POST /identity/v3/users => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:41:09.303832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34148c86-50ef-4a31-8000-ca3e424779d7 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:09.304407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34148c86-50ef-4a31-8000-ca3e424779d7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:09.304513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34148c86-50ef-4a31-8000-ca3e424779d7 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:09.306792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 601/1206] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:09.315075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:09.315535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:09.315617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:09.335703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:09.337128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:09.420600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 606/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:09.452161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34148c86-50ef-4a31-8000-ca3e424779d7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:09.580600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34148c86-50ef-4a31-8000-ca3e424779d7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:09.619879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:09.620759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:09.621096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:09.621343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:09.633941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:41:09.641531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:41:09.642953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 602/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:41:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:09.651371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:09.765123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378e967-a3df-4a76-8b9f-188da808f8f6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:09.803530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:09.804254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:09.804548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:09.804897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:09.805647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:09.806174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:09.807594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:09.817336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 607/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:41:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:09.824583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:09.940859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e302837-aebb-4fc3-ac1e-9fb713ba14e3 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:09.983065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:09.984549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:09.984917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:09.985118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:09.997722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:10.000041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:10.022701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:10.024095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 603/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:10.029742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:10.141596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547a58b-893e-49d5-8a4a-7746e04740b7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:10.177187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:10.179068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:10.181709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:10.181709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:10.181709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:10.181709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:10.182343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:10.198913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 608/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:10.205360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:10.317935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6c42-9e2b-46cc-91dd-7aa1062dac31 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:10.362261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:10.363192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:10.363617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:10.363904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:10.372549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:10.374402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:10.389407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 14:41:10.391142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 604/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:10.398117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:10.506599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6331-115f-40f7-ae40-889fe195c655 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:10.540856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:10.541630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:10.542010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:10.542356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:10.543262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:10.543644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:10.545174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:10.565594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 609/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Mar 8 14:41:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:10.571543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:10.685905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9718-1da4-422d-8413-cb1c0ae688f0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:10.727931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:10.729373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:10.729653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:10.729976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:10.808588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:10.810175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:10.926018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 605/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:41:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:41:10.932117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:11.056381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ad36f-0ad8-465f-beb1-6c8241c94aa1 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:11.096509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:11.097529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:11.097812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:11.098110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:11.110419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:11.112228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:11.134910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:11.136579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 610/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:11.142303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:11.251632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9a9e-66c3-4a78-981e-8427e43fe772 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:11.293293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:11.293990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:11.294278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:11.294555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:11.295277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:11.295571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:11.296960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:11.309693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 606/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:11.315177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:11.424574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf893ab-f7e2-4625-8e7c-85f5cb153662 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:11.464959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:11.466336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:11.466779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:11.467280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:11.476704 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:11.478892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:11.497513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:41:11.503919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 611/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:11.504971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:11.627529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb71862-209d-4463-a9c3-682d50eae173 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:11.671868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:11.672576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:11.672895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:11.673160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:11.674027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:11.674326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:11.675909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618b3f3-0577-4ba0-b054-fb470801be91 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:11.689253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 607/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:11.696083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:11.809253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc7c1-9b9b-413c-ba60-749aba0b7235 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:11.845982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:11.846796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:11.847184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:11.847560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:11.848490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=aa5f9bb835104f1c95d0ccc6ddd02de8) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:11.848921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:11.851039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6046f-59ee-4769-ae91-f428f53688e6 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:11.856871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 612/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:41:11 2022] GET /identity/v3/role_assignments?user.id=aa5f9bb835104f1c95d0ccc6ddd02de8&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:14.219744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51c346-530d-4211-ad91-80c2a18837dc None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:14.220268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51c346-530d-4211-ad91-80c2a18837dc None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:14.220268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51c346-530d-4211-ad91-80c2a18837dc None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:14.222023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 608/1220] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:14.228226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:14.228653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:14.228759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:14.248340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:14.249764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:14.320917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 613/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:14.345304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51c346-530d-4211-ad91-80c2a18837dc None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:14.451535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51c346-530d-4211-ad91-80c2a18837dc None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:14.487444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:14.488250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:14.488536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:14.488810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:14.500486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:41:14.508065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:41:14.509326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 609/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:41:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:14.515718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:14.621924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf6aa-4059-40fa-b2a4-e527d8bf8a41 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:14.657003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:14.657733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:14.658097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:14.658339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:14.659088 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:14.659389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:14.660872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:14.669211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 614/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:41:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:41:14.675152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:14.779441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2a1d3-7cec-4c84-a521-bcd9fd6233f4 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:14.813495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:14.814356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:14.814644 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:14.814916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:14.826002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:14.827456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:14.844484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:14.845953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 610/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:14.852447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:14.972218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5265f7b-6c0e-4dd0-a354-0be8002096b8 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:15.017843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:15.018575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:15.018953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:15.019326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:15.020140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:15.020446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:15.022769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:15.036478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 615/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:41:15.042583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:15.151793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b8a20-ab09-4fc9-a6b1-9faaa8645236 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:15.189326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:15.190164 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:15.190480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:15.190763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:15.198640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:15.200093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:15.214147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 14:41:15.215346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 611/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:15.221175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:15.324795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85270c-4d6e-4d68-b489-f44ed0da8234 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:15.359618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:15.359840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:15.360110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:15.360384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:15.361232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:15.361508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:15.362990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:15.382669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 616/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Mar 8 14:41:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:15.388369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:15.498902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a34d-ce5b-481f-a4d1-062fd965ac04 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:15.534056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:15.534922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:15.535228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:15.535511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:15.547774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:15.549542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:15.568946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:15.570431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 612/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:41:15.577258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:15.684187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba76eca-db99-47ea-bbd5-f8ca47376c1c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:15.720416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:15.721083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:15.721363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:15.721633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:15.722373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:15.722674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:15.724046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:15.737904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 617/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:15.742554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:15.843340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5570d-4218-47ca-a0cc-4d4c3305f8a5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:15.876537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:15.877332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:15.877630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:15.878004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:15.886155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:15.887780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:15.903356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:41:15.904535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 613/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:15.910643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:16.018943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7759-eb4c-42e9-a2e3-5e94ef404647 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:16.053485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:16.054240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:16.054522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:16.054804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:16.055725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:16.056142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:16.057905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893520ef-770e-4c17-8945-328896f4da8a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:16.071614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 618/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:16.078088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:16.188977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e11aa-ad6e-401d-ae05-7d7c092d9830 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:16.224461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51a90f-309e-4dd0-87b0-6eb19565276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:16.225519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a90f-309e-4dd0-87b0-6eb19565276e None admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:16.225802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a90f-309e-4dd0-87b0-6eb19565276e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:16.226113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a90f-309e-4dd0-87b0-6eb19565276e None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/aa5f9bb835104f1c95d0ccc6ddd02de8/roles/1496f3a32cbe43d2a24c22e686706d95` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:16.244420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51a90f-309e-4dd0-87b0-6eb19565276e None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=aa5f9bb835104f1c95d0ccc6ddd02de8, role_id=1496f3a32cbe43d2a24c22e686706d95)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:16.245837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51a90f-309e-4dd0-87b0-6eb19565276e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:16.260382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 614/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:41:16 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/aa5f9bb835104f1c95d0ccc6ddd02de8/roles/1496f3a32cbe43d2a24c22e686706d95 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:41:18.766695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e193300-f1e2-4bd4-abf6-da286e165abb None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:18.767228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e193300-f1e2-4bd4-abf6-da286e165abb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:18.767490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e193300-f1e2-4bd4-abf6-da286e165abb None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:18.769612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 619/1233] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:18.775840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:18.776278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:18.776399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:18.794108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:18.796126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:18.869484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 615/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 14:41:18.893760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e193300-f1e2-4bd4-abf6-da286e165abb None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:19.023062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e193300-f1e2-4bd4-abf6-da286e165abb None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:19.060213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:19.061097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:19.061386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:19.061657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:19.072901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:41:19.080335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 14:41:19.081701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 620/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Mar 8 14:41:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:19.088260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:19.188696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f8d40-42b7-4f5a-93c3-a3ae321f9d63 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:19.224820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:19.225685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:19.226040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:19.226274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:19.227165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:19.227474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:19.228978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:19.237191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 616/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Mar 8 14:41:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:19.243373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:19.345426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec6eb2-0713-4554-a10c-e271876a3682 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:19.383408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:19.384251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:19.384530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:19.384846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:19.396512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:19.398096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:19.416756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:19.418020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 621/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:19.423920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:19.532145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8bb2a-6dc8-45fb-ab85-c9da6ecde3a8 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:19.568491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:19.569251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:19.569540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:19.569819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:19.570635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:19.570974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:19.572701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:19.585224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 617/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:19.591524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:19.695312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901b880-8d0d-4c7b-8f2d-a212b583b438 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:19.731501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:19.732337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:19.732647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:19.732928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:19.740823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:19.742348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:19.758220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 14:41:19.759407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 622/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 14:41:19.765360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:19.875297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2473e0-1442-4080-9a5e-40e21a89fb17 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:19.918929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:19.919940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:19.920232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:19.920535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:19.921502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:19.921842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:19.923567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:19.941891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 618/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Mar 8 14:41:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:19.948254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:20.065132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c702d-0862-4a1a-9189-372b717bfff3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:20.101996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:20.102695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:20.103016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:20.103310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:20.171442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:20.172957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:20.283742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 623/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:41:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:41:20.290352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:20.401283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9b9d-a0da-4db8-8d5f-e0b7b0b5126b None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:20.445012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:20.445953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:20.446237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:20.446589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:20.460822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:20.462412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:20.482710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:20.485903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 619/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:20.490899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:20.598457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f6c31-d77a-4c29-a20a-14823eeb0eb3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:20.635466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:20.636152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:20.636436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:20.636753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:20.637494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:20.637802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:20.639212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:20.651448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 624/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:20.657282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:20.768169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4d368-ab0a-4791-8b67-2b8bd3a9506a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:20.806031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:20.806834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:20.807117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:20.807391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:20.814467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:20.816068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:20.831462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:41:20.832877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 620/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:20.839493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:20.953342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2443a7f-6bea-4146-ad7c-31ac0180a93e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:20.994980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:20.995639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:20.996066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:20.996321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:20.997250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:20.998968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:21.000485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba4c79-19be-4ed5-896e-c377c2e0fe0e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:21.014675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 625/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:21.021628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:21.127787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661cdc1-8781-437b-8587-206d35a5c622 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:21.171742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314959d6-ff17-467b-b533-725388434385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:21.172900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314959d6-ff17-467b-b533-725388434385 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:21.173444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314959d6-ff17-467b-b533-725388434385 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:21.173975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314959d6-ff17-467b-b533-725388434385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:21.175433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314959d6-ff17-467b-b533-725388434385 None admin] RBAC: Adding query filter params (role.id=1496f3a32cbe43d2a24c22e686706d95, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=aa5f9bb835104f1c95d0ccc6ddd02de8) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:21.175966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314959d6-ff17-467b-b533-725388434385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:21.179176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314959d6-ff17-467b-b533-725388434385 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:21.187136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 621/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:41:21 2022] GET /identity/v3/role_assignments?user.id=aa5f9bb835104f1c95d0ccc6ddd02de8&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=1496f3a32cbe43d2a24c22e686706d95 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:23.620402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cf3c4-d720-47f5-a90a-d50dcb78edf4 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:23.620954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cf3c4-d720-47f5-a90a-d50dcb78edf4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:23.620954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cf3c4-d720-47f5-a90a-d50dcb78edf4 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:23.623046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 626/1247] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:23.628818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:23.629359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:23.629359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:23.647593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:23.648814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:23.718446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 622/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:23.743062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cf3c4-d720-47f5-a90a-d50dcb78edf4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:23.843384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cf3c4-d720-47f5-a90a-d50dcb78edf4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:23.875818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:23.876537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:23.876813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:23.877083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:23.887017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:41:23.894062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:41:23.895395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 627/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:23.902561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:24.018042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47509b-2500-437a-8c21-80fa24c02386 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:24.053982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:24.054666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:24.054954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:24.055234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:24.055979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:24.056288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:24.057676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:24.065821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 623/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:24.072621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:24.168838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ace2-f1e6-4cd2-b8cd-a337947afef7 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:24.200002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:24.200784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:24.201063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:24.201335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:24.213216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:24.214686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:24.230499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:24.231641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 628/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:24.237388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:24.339327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae3ec-2fb5-4866-967b-44e6e606b31d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:24.370429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:24.371074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:24.371352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:24.371626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:24.372326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:24.372627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:24.374001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:24.385729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 624/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:24.391493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:24.487358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac29fe-d4bd-4a6d-8286-8a02fe1e82c5 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:24.519799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:24.520585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:24.520890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:24.521165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:24.528270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:24.529714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:24.543031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 14:41:24.544165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 629/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:24.549987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:24.645006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919020-1215-4fe5-8704-995365cdcc83 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:24.676804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:24.678183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:24.678474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:24.678749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:24.679563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:24.679871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:24.681289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:24.697571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 625/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Mar 8 14:41:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:24.703168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:24.795615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b079c-31cb-4d46-834d-c68873f351eb None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:24.826700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:24.827325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:24.827605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:24.827877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:24.889356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:24.890820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:24.988082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 630/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:41:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:41:24.994775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:25.089699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6044-7dd4-44e0-a8f5-080ae965f730 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:25.121069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:25.121874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:25.122155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:25.122424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:25.131871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:25.133293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:25.149937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:25.151077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 626/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:25.156718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:25.249685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e660-e299-4233-a695-624b5ce22301 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:25.282610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:25.283257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:25.283539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:25.283813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:25.284519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:25.284826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:25.286227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:25.297412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 631/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:25.302841 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:25.395151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404c03-cdb6-4937-b526-9d6c20bde219 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:25.426866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:25.427671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:25.427942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:25.428215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:25.434473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:25.435890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:25.449287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:41:25.450428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 627/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:25.456146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:25.548790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97108-9093-4547-bf47-dea6ea35c093 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:25.579724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:25.580352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:25.580630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:25.580895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:25.581730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:25.582060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:25.583525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778c28-9d5b-4be5-8426-bc558f19621a None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:25.594675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 632/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:41:25.601055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:25.700831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fe877-4346-443e-84d9-1bf6842d4b17 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:25.732151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:25.732793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:25.733077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:25.733354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:25.734202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=aa5f9bb835104f1c95d0ccc6ddd02de8) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:25.734516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:25.735935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b724-d1e3-473e-9295-6404d358b523 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:25.741926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 628/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:41:25 2022] GET /identity/v3/role_assignments?user.id=aa5f9bb835104f1c95d0ccc6ddd02de8&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:27.986225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09dff5-7292-4f2a-acd4-eef0e9867c75 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:27.986763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09dff5-7292-4f2a-acd4-eef0e9867c75 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:27.986763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09dff5-7292-4f2a-acd4-eef0e9867c75 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:27.988552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 633/1261] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:27.994469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:27.994926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:27.995082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:28.014971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:28.016192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:28.086966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 629/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:28.109662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09dff5-7292-4f2a-acd4-eef0e9867c75 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:28.207610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09dff5-7292-4f2a-acd4-eef0e9867c75 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:28.239162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:28.241053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:28.241331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:28.241601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:28.251060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:41:28.258690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:41:28.259856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 634/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:28.265731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:28.360746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c0e0c-aee9-4534-a00d-f9e941a5c2dd None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:28.392107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:28.392754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:28.393029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:28.393300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:28.394046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:28.394344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:28.396176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:28.403658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 630/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:28.409281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:28.501109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ab80-9b1d-4a3b-a271-de92d0f7567d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:28.531831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:28.532599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:28.532875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:28.533144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:28.543482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:28.544913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:28.560634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:28.561750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 635/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:28.567304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:28.660402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6653035-33b4-4b33-a778-01a46c3de15a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:28.690653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:28.691291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:28.691570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:28.691844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:28.693057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:28.693355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:28.694727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:28.705784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 631/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:28.712372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:28.804554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a30118-2894-4f80-aefd-133a97284d15 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:28.835554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:28.836335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:28.836612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:28.836879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:28.843822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:28.845243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:28.858311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 14:41:28.859429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 636/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:28.865474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:28.957153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dd48a-dd63-402a-9b3e-03ed98b9095e None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:28.998541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:28.999195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:28.999471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:28.999743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:29.000554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:29.000857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:29.002294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:29.018410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 632/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Mar 8 14:41:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:29.024529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:29.117136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef594174-499e-4be2-ab50-b20da06d20e3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:29.147837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:29.148614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:29.148898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:29.149168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:29.159702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:29.161132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:29.177359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:29.178501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 637/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:29.184123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:29.277418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09d5c4-855a-4c4d-965c-1aa9739fd606 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:29.307979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:29.308620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:29.308899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:29.309172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:29.309886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:29.310195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:29.311542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:29.322779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 633/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:29.328541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:29.421621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214911-a8af-4d25-8d47-4c4f4c67199e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:29.452635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:29.453412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:29.453688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:29.453985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:29.460948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:29.462421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:29.475994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:41:29.477117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 638/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:29.482952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:29.577946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8534f-ef4f-4036-bc0c-af02fccb9f33 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:29.610071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:29.610713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:29.610994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:29.611265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:29.612030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:29.612343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:29.613755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608409f-f71d-4be8-af87-f55cd41c758a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:29.633312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 634/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:29.639154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:29.732127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d89e-4215-4e2b-8f66-6b087042de2c None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:29.764204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909fc8b-fa50-44fa-914a-66bbed4db90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:29.765083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909fc8b-fa50-44fa-914a-66bbed4db90f None admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:29.765366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909fc8b-fa50-44fa-914a-66bbed4db90f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:29.765641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909fc8b-fa50-44fa-914a-66bbed4db90f None admin] PATH_INFO: `/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/aa5f9bb835104f1c95d0ccc6ddd02de8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:29.767595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909fc8b-fa50-44fa-914a-66bbed4db90f None admin] RBAC: Authorizing `identity:create_grant(project_id=0a59ee8f893149c7849213e5bbc06593, user_id=aa5f9bb835104f1c95d0ccc6ddd02de8, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:29.769036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909fc8b-fa50-44fa-914a-66bbed4db90f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:29.781154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 639/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Mar 8 14:41:29 2022] PUT /identity/v3/projects/0a59ee8f893149c7849213e5bbc06593/users/aa5f9bb835104f1c95d0ccc6ddd02de8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:41:32.072480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19c84-1b4d-4b2d-aa8b-8c6607e854b4 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.073004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19c84-1b4d-4b2d-aa8b-8c6607e854b4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.073116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f19c84-1b4d-4b2d-aa8b-8c6607e854b4 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.074895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 635/1274] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:32.079999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.080387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.080558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.096905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:32.098120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:32.160992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 640/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:32.185227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19c84-1b4d-4b2d-aa8b-8c6607e854b4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:32.279808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f19c84-1b4d-4b2d-aa8b-8c6607e854b4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:32.310318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:32.311092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.311369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.311636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.321817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 14:41:32.333583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 14:41:32.335401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 636/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Mar 8 14:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:32.343435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:32.436530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b898ac0-6fa7-47bf-aae6-cb04ea12a6fa None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:32.468421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:32.469070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.469347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.469622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.470376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:32.470679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:32.472038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:32.479565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 641/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Mar 8 14:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:32.485304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:32.580651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553d51-681a-4ad9-a8b2-9350c3eb23b5 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:32.611976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:32.612760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.613045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.613325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.624271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:32.625731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:32.642341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:32.643477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 637/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:32.649051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:32.747146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5398b2-597d-4526-8b35-ea4d5396be7d None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:32.778486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:32.779140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.779423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.779698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.780407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:32.780716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:32.782115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:32.793823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 642/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:32.799319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:32.892660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe2db4-eff0-47a3-b9f4-e83eb5a991b0 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:32.923572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:32.924351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:32.924638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:32.924905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:32.932021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:32.933430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:32.948027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 14:41:32.949198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 638/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:32.954955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:33.064496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b473-31e7-42ac-b0b3-ca6663c22a76 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:33.097963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:33.098905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:33.099360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:33.099636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:33.100453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:33.100758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:33.102212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:33.118380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 643/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Mar 8 14:41:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:33.124039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:33.218292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82a92b-19ab-4e6a-b798-a932e9ad023a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:33.249251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:33.249908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:33.250196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:33.250479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:33.318420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:33.319859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:33.410137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 639/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Mar 8 14:41:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 14:41:33.416628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:33.512005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb687e7a-1138-4737-af14-6583f85071c3 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:33.543266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:33.544046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:33.544324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:33.544596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:33.555114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:33.556559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:33.574028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 14:41:33.575158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 644/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:33.580667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:33.672019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda6dc6-2d99-4614-a53c-2b96044e1d1c None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:33.703695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:33.704332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:33.704611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:33.704885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:33.705580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:33.705997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:33.707253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:33.718037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 640/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Mar 8 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:33.723439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:33.815340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3d756-bdfd-42a0-bbfc-f8b88c89ce1e None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:33.846226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:33.846992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:33.847270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:33.847539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:33.854488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:33.855917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:33.868531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING keystone.server.flask.application [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 14:41:33.869648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 645/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Mar 8 14:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:33.875314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:33.971717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3a846-1f5d-4f84-9932-e830d1e2c281 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:34.003199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:34.003850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:34.004135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:34.004412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:34.005838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:34.006178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:34.007607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c58a-c0f7-47bc-9800-bea6fbfad6d9 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:34.018927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 641/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Mar 8 14:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:34.025569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:34.119385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c59d1-1e14-4407-8be7-1ac185d4cf45 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:34.150289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:34.150919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:34.151200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:34.151473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:34.152280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] RBAC: Adding query filter params (role.id=a8acc8ba06f94cc78a1bcb22d8f1d819, scope.project.id=0a59ee8f893149c7849213e5bbc06593, user.id=aa5f9bb835104f1c95d0ccc6ddd02de8) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:34.152589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:34.154040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d37141-0922-49e0-a457-0197187dcd5f None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:34.159497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 646/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Mar 8 14:41:34 2022] GET /identity/v3/role_assignments?user.id=aa5f9bb835104f1c95d0ccc6ddd02de8&scope.project.id=0a59ee8f893149c7849213e5bbc06593&role.id=a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:36.445789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930856a1-3843-4fa9-bd47-2978bc5a4dbf None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:36.446343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930856a1-3843-4fa9-bd47-2978bc5a4dbf None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:36.446343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930856a1-3843-4fa9-bd47-2978bc5a4dbf None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:36.448376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 642/1288] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:36.453533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:36.453937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:36.454115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:36.470480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:36.471664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:36.534991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 647/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:36.556999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930856a1-3843-4fa9-bd47-2978bc5a4dbf None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:36.653211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930856a1-3843-4fa9-bd47-2978bc5a4dbf None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:36.685512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:36.686326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:36.686610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:36.686885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:36.687523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:36.688885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:36.700026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 14:41:36.701098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 643/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:41:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:36.707159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:36.796479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a92f4-a115-4a5e-9435-a3de97ae42dd None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:36.827624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:36.828267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:36.828545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:36.828813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:36.829495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:36.829792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:36.831172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01c3c-af12-4a13-93fa-3ed19dd0c277 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:36.835780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 648/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Mar 8 14:41:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:36.841423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:36.934972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0633923-24ac-46a4-9069-b1dd6110fd2d None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:36.970043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:36.970763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:36.971098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:36.971411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] PATH_INFO: `/v3/services` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:36.972466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:36.972827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:36.975823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd814f-930e-4317-8940-c579172f7511 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:36.980883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 644/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Mar 8 14:41:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:39.275106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2fe4-8a68-4100-a3c6-af9540efba5e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:39.275616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2fe4-8a68-4100-a3c6-af9540efba5e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:39.275735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2fe4-8a68-4100-a3c6-af9540efba5e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:39.277411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 649/1293] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:39.282586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6fa2-14fb-437f-a3c0-08681c7729ce None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:39.282988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6fa2-14fb-437f-a3c0-08681c7729ce None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:39.283156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6fa2-14fb-437f-a3c0-08681c7729ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:39.300215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0e0a6fa2-14fb-437f-a3c0-08681c7729ce None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:39.301406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0e0a6fa2-14fb-437f-a3c0-08681c7729ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:39.366163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 645/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:39.388365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2fe4-8a68-4100-a3c6-af9540efba5e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:39.482374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2fe4-8a68-4100-a3c6-af9540efba5e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:39.513307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c01ee5-68f1-4435-90b1-7a86d3235401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:39.513975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c01ee5-68f1-4435-90b1-7a86d3235401 None admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:39.514254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c01ee5-68f1-4435-90b1-7a86d3235401 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:39.514525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c01ee5-68f1-4435-90b1-7a86d3235401 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:39.515222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c01ee5-68f1-4435-90b1-7a86d3235401 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:39.516574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c01ee5-68f1-4435-90b1-7a86d3235401 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:39.529326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 650/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Mar 8 14:41:39 2022] POST /identity/v3/services => generated 246 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:41:41.872431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4097-f180-407f-9435-ae38c6c14916 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:41.873067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4097-f180-407f-9435-ae38c6c14916 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:41.873067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4097-f180-407f-9435-ae38c6c14916 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:41.874776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 646/1296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:41.880377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:41.880768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:41.880922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:41.897076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:41.898274 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:41.969279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 651/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:41.997865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf4097-f180-407f-9435-ae38c6c14916 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:42.093541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf4097-f180-407f-9435-ae38c6c14916 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:42.124808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:42.125541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:42.125825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:42.126135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] PATH_INFO: `/v3/services/placement` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:42.126778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:42.128130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:42.139700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 14:41:42.140824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 647/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:41:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:42.146901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:42.238447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96636a-b94f-4185-9547-ad6eb95eff14 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:42.270296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:42.270947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:42.271229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:42.271506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:42.272199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:42.272504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:42.273896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:42.278754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 652/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Mar 8 14:41:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:42.284458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:42.378811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b9a4-fbf3-4bda-9fd4-0fc53d7f7e3a None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:42.410370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:42.411611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:42.411892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:42.412169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:42.412944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] RBAC: Adding query filter params (interface=public, service_id=d3719f863d614e13bad619db70d7587e, region_id=RegionOne) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:42.413256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:42.414641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28fd9-fd5d-43c0-8c99-906b587c6efb None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:42.419429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 648/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Mar 8 14:41:42 2022] GET /identity/v3/endpoints?service_id=d3719f863d614e13bad619db70d7587e&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:42.424857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:42.515658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17570f-47f3-45ee-99c1-a050815ef813 None admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:42.547221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea6c8-07f5-429c-b4e3-14b4b02672fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:42.547865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea6c8-07f5-429c-b4e3-14b4b02672fe None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:42.548140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea6c8-07f5-429c-b4e3-14b4b02672fe None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:42.548411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea6c8-07f5-429c-b4e3-14b4b02672fe None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:42.549073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea6c8-07f5-429c-b4e3-14b4b02672fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:42.550460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea6c8-07f5-429c-b4e3-14b4b02672fe None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:42.557125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 653/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Mar 8 14:41:42 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:41:44.846211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a726de-a351-4c5f-a4f3-535e8dbc5521 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:44.846733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a726de-a351-4c5f-a4f3-535e8dbc5521 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:44.847024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a726de-a351-4c5f-a4f3-535e8dbc5521 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:44.849648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 649/1302] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:41:44.854831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:44.855261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:44.855395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:44.872782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:41:44.873989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:41:44.938065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 654/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:41:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 14:41:44.962582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a726de-a351-4c5f-a4f3-535e8dbc5521 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:45.060081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a726de-a351-4c5f-a4f3-535e8dbc5521 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:45.091850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:45.092635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:45.092919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:45.093197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:45.093837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:45.095227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:45.107003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING keystone.server.flask.application [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 14:41:45.108075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 650/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Mar 8 14:41:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 14:41:45.114778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:45.204517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68055364-a436-4f70-937a-bd9ec54237bb None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:45.235842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:45.236486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:45.236763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:45.237035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] PATH_INFO: `/v3/services` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:45.237719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:41:45.238050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:45.240133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bfa61-5d9b-4736-ab93-11453bf35b57 None admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:45.244937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 655/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Mar 8 14:41:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:41:45.250664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:41:45.346060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a1aa-4c90-4c7e-9aa5-a66d837b26e2 None admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:41:45.377774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76677-ea52-4672-8868-f81196ee15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:41:45.378392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76677-ea52-4672-8868-f81196ee15ce None admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:41:45.378684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76677-ea52-4672-8868-f81196ee15ce None admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:41:45.378962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76677-ea52-4672-8868-f81196ee15ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:41:45.379862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd76677-ea52-4672-8868-f81196ee15ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:41:45.381267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd76677-ea52-4672-8868-f81196ee15ce None admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:41:45.399319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 651/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Mar 8 14:41:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:42:48.589404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7abc4c-2e0c-4373-8da8-1815cc5a3ab5 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:48.590037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7abc4c-2e0c-4373-8da8-1815cc5a3ab5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:48.590037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7abc4c-2e0c-4373-8da8-1815cc5a3ab5 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:48.591901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 656/1307] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:42:48.599872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf278f0-89e9-4e23-8f8b-5df68b381eb3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:48.600354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf278f0-89e9-4e23-8f8b-5df68b381eb3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:48.600446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf278f0-89e9-4e23-8f8b-5df68b381eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:48.795686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-baf278f0-89e9-4e23-8f8b-5df68b381eb3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:42:48.798383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-baf278f0-89e9-4e23-8f8b-5df68b381eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:48.916546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 652/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:42:48.944172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7abc4c-2e0c-4373-8da8-1815cc5a3ab5 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:42:48.946316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5a7abc4c-2e0c-4373-8da8-1815cc5a3ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:49.142091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7abc4c-2e0c-4373-8da8-1815cc5a3ab5 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:42:49.236407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:42:49.237376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:49.237818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:49.238281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:49.239146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:42:49.241044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:42:49.241044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:42:49.241044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:42:49.242526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4752d47-79d3-4d8a-a647-6606e9a4f2c3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:42:49.262549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 657/1309] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:42:48 2022] GET /identity/v3/projects => generated 2553 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:42:51.807836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422b143-3185-4178-a8c2-2d6627f0bd61 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:51.808392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422b143-3185-4178-a8c2-2d6627f0bd61 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:51.808392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422b143-3185-4178-a8c2-2d6627f0bd61 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:51.810276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 653/1310] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:42:51.815895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5dae-8a4f-423c-bef9-aff4ca7c4a17 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:51.816342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5dae-8a4f-423c-bef9-aff4ca7c4a17 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:51.816446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa5dae-8a4f-423c-bef9-aff4ca7c4a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:51.894902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6baa5dae-8a4f-423c-bef9-aff4ca7c4a17 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:42:51.896191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6baa5dae-8a4f-423c-bef9-aff4ca7c4a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:51.999670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 658/1311] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:42:52.053345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a174a-d680-4be6-9977-f0271f8c5b8a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:52.053629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a174a-d680-4be6-9977-f0271f8c5b8a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:52.053958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a174a-d680-4be6-9977-f0271f8c5b8a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:52.055800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 654/1312] 10.222.0.30 () {54 vars in 964 bytes} [Tue Mar 8 14:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:42:52.063376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7fa1-d009-4096-a613-050d7cb4f70c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:52.063376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7fa1-d009-4096-a613-050d7cb4f70c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:52.063643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7fa1-d009-4096-a613-050d7cb4f70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:52.156302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-badb7fa1-d009-4096-a613-050d7cb4f70c None None] MFA Rules not processed for user `e45b81aa59fd4b26bc1434c9191c20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:42:52.157606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-badb7fa1-d009-4096-a613-050d7cb4f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:52.237154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 659/1313] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Mar 8 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:42:52.246388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a174a-d680-4be6-9977-f0271f8c5b8a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:42:52.248126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a01a174a-d680-4be6-9977-f0271f8c5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:52.352833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a174a-d680-4be6-9977-f0271f8c5b8a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:42:52.423572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:42:52.424221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:52.424505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:52.424779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:52.426441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:52.548798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:42:52.550177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ade94-1ac2-4d06-9573-13d5d7ee36ba service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:42:52.568723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 655/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:42:55.170001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261de6b9-330c-45ab-8828-43ef941154c3 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:55.170499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261de6b9-330c-45ab-8828-43ef941154c3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:55.170499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261de6b9-330c-45ab-8828-43ef941154c3 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:55.172229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 660/1315] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:42:55.177875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515de63-896a-49a1-b1f1-a85e9c6ad46b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:55.178287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515de63-896a-49a1-b1f1-a85e9c6ad46b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:55.178455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515de63-896a-49a1-b1f1-a85e9c6ad46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:55.243086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8515de63-896a-49a1-b1f1-a85e9c6ad46b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:42:55.244291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8515de63-896a-49a1-b1f1-a85e9c6ad46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:55.336056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 656/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:42:55.374134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261de6b9-330c-45ab-8828-43ef941154c3 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:42:55.375639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-261de6b9-330c-45ab-8828-43ef941154c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:55.473834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261de6b9-330c-45ab-8828-43ef941154c3 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:42:55.541696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:42:55.542358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:55.542634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:55.542904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:55.544511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:55.646340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:42:55.647773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e41de-9f78-4612-932f-d059ddc71903 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:42:55.665407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 661/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:42:58.283512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac63324-38cf-4df5-b04c-185385bdf002 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:58.284058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac63324-38cf-4df5-b04c-185385bdf002 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:58.284058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac63324-38cf-4df5-b04c-185385bdf002 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:58.285829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 657/1318] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:42:58.291154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75d93-ca2e-4c83-9a68-6fff1502acc7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:58.291580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75d93-ca2e-4c83-9a68-6fff1502acc7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:58.291731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75d93-ca2e-4c83-9a68-6fff1502acc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:58.355708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-edf75d93-ca2e-4c83-9a68-6fff1502acc7 None None] MFA Rules not processed for user `9bfc026c06624bf8a533e636baa46d35`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:42:58.356892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-edf75d93-ca2e-4c83-9a68-6fff1502acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:58.449366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 662/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:42:58.490354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac63324-38cf-4df5-b04c-185385bdf002 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:42:58.491865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0ac63324-38cf-4df5-b04c-185385bdf002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:58.589949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac63324-38cf-4df5-b04c-185385bdf002 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:42:58.658866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:42:58.659491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:42:58.659768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:42:58.660045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:42:58.661639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:42:58.763987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:42:58.765413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd6af1-7e45-47e5-9a7e-bc8fa68e4899 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:42:58.783992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 658/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:01.638206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e5b6e-2e19-4018-979d-2b9e2035f432 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:01.638774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e5b6e-2e19-4018-979d-2b9e2035f432 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:01.638774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e5b6e-2e19-4018-979d-2b9e2035f432 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:01.640535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 663/1321] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:01.646682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b63b9-53c9-4035-8136-2a5c2f8e2e29 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:01.647115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b63b9-53c9-4035-8136-2a5c2f8e2e29 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:01.647238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b63b9-53c9-4035-8136-2a5c2f8e2e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:01.709153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ae4b63b9-53c9-4035-8136-2a5c2f8e2e29 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:01.710364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ae4b63b9-53c9-4035-8136-2a5c2f8e2e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:01.803220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 659/1322] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:01.842035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e5b6e-2e19-4018-979d-2b9e2035f432 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:01.843566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d70e5b6e-2e19-4018-979d-2b9e2035f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:01.941947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e5b6e-2e19-4018-979d-2b9e2035f432 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:02.012514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:02.013159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:02.013445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:02.013723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:02.015397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:02.118464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:02.119896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c72ee-d74a-4e37-b9d9-0fdbae30440a service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:02.137057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 664/1323] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:05.072900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf096-2ab5-4e34-aad9-4e06ccc038a0 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:05.073404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf096-2ab5-4e34-aad9-4e06ccc038a0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:05.073404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf096-2ab5-4e34-aad9-4e06ccc038a0 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:05.075320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 660/1324] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:05.080825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c389838-1e4b-477d-8dfd-22e2cd0a770a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:05.081256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c389838-1e4b-477d-8dfd-22e2cd0a770a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:05.081418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c389838-1e4b-477d-8dfd-22e2cd0a770a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:05.146560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7c389838-1e4b-477d-8dfd-22e2cd0a770a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:05.147750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7c389838-1e4b-477d-8dfd-22e2cd0a770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:05.242640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 665/1325] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:05.278646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf096-2ab5-4e34-aad9-4e06ccc038a0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:05.280192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-243bf096-2ab5-4e34-aad9-4e06ccc038a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:05.381086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf096-2ab5-4e34-aad9-4e06ccc038a0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:05.457316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:05.458000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:05.458285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:05.458563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:05.460206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:05.565744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:05.567211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613083b4-4129-47d4-95d2-9feda9e406d1 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:05.585400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 661/1326] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:07.936708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8bd80-61d9-4ff3-816c-9b179aa1ee8c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:07.937261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8bd80-61d9-4ff3-816c-9b179aa1ee8c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:07.937261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8bd80-61d9-4ff3-816c-9b179aa1ee8c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:07.939046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 666/1327] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:07.944858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e89b0-ed9f-4efc-ac09-6fe3d7c1a17e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:07.945264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e89b0-ed9f-4efc-ac09-6fe3d7c1a17e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:07.945436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e89b0-ed9f-4efc-ac09-6fe3d7c1a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:08.012111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-319e89b0-ed9f-4efc-ac09-6fe3d7c1a17e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:08.013314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-319e89b0-ed9f-4efc-ac09-6fe3d7c1a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:08.105919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 662/1328] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:08.141548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8bd80-61d9-4ff3-816c-9b179aa1ee8c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:08.143120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-49c8bd80-61d9-4ff3-816c-9b179aa1ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:08.243203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8bd80-61d9-4ff3-816c-9b179aa1ee8c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:08.312994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:08.313843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:08.314128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:08.314404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:08.316022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:08.418602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:08.420042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea436-276c-43b3-9905-17ed96df6474 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:08.437967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 667/1329] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:10.834388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e85a2-1c4c-4309-be24-064088153a88 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:10.834909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e85a2-1c4c-4309-be24-064088153a88 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:10.835018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e85a2-1c4c-4309-be24-064088153a88 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:10.836785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 663/1330] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:10.842124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d59fe-76b8-4286-9368-c75d69cf40bb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:10.842513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d59fe-76b8-4286-9368-c75d69cf40bb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:10.842681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d59fe-76b8-4286-9368-c75d69cf40bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:10.908925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b57d59fe-76b8-4286-9368-c75d69cf40bb None None] MFA Rules not processed for user `9bfc026c06624bf8a533e636baa46d35`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:10.910148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b57d59fe-76b8-4286-9368-c75d69cf40bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:11.013440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 668/1331] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:11.051651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e85a2-1c4c-4309-be24-064088153a88 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:11.053113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-974e85a2-1c4c-4309-be24-064088153a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:11.166540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e85a2-1c4c-4309-be24-064088153a88 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:11.237315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:11.237988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:11.238269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:11.238539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:11.240143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:11.343986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:11.345356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217063-c506-4027-9d4d-3e47ec34c82e service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:11.362577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 664/1332] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:13.913770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af05bf7-5d51-4b2e-ae0c-006543f19a46 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:13.914353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af05bf7-5d51-4b2e-ae0c-006543f19a46 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:13.914353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af05bf7-5d51-4b2e-ae0c-006543f19a46 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:13.916021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 669/1333] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:13.921198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e587ae-968e-4f8d-9c5c-1d2dcd64fc22 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:13.921591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e587ae-968e-4f8d-9c5c-1d2dcd64fc22 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:13.921758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e587ae-968e-4f8d-9c5c-1d2dcd64fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:13.988039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-52e587ae-968e-4f8d-9c5c-1d2dcd64fc22 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:13.989228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-52e587ae-968e-4f8d-9c5c-1d2dcd64fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:14.082768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 665/1334] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:14.117881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af05bf7-5d51-4b2e-ae0c-006543f19a46 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:14.119458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5af05bf7-5d51-4b2e-ae0c-006543f19a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:14.226124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af05bf7-5d51-4b2e-ae0c-006543f19a46 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:14.299803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:14.300457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:14.300740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:14.301015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:14.302712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:14.412889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:14.414391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcb0b5-dc18-493e-a433-9f92631f9360 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:14.432341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 670/1335] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:16.783802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8a19-4502-4ec7-9ac8-0345df0fe488 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:16.784357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8a19-4502-4ec7-9ac8-0345df0fe488 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:16.784357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8a19-4502-4ec7-9ac8-0345df0fe488 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:16.786167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 666/1336] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:16.791292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d103c3-bdde-4f12-8d1c-ebb3733746dc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:16.791731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d103c3-bdde-4f12-8d1c-ebb3733746dc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:16.791860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d103c3-bdde-4f12-8d1c-ebb3733746dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:16.857591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-47d103c3-bdde-4f12-8d1c-ebb3733746dc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:16.859127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-47d103c3-bdde-4f12-8d1c-ebb3733746dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:16.952868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 671/1337] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:17.010923 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eeba4-af2c-4552-9711-28bc3a90431a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:17.011207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eeba4-af2c-4552-9711-28bc3a90431a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:17.011487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2eeba4-af2c-4552-9711-28bc3a90431a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:17.013257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 667/1338] 10.222.0.30 () {54 vars in 964 bytes} [Tue Mar 8 14:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:17.020087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a1486-e242-45f1-8cc8-86f11d28a2ef None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:17.020375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a1486-e242-45f1-8cc8-86f11d28a2ef None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:17.020656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a1486-e242-45f1-8cc8-86f11d28a2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:17.096703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ad5a1486-e242-45f1-8cc8-86f11d28a2ef None None] MFA Rules not processed for user `e45b81aa59fd4b26bc1434c9191c20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:17.097810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ad5a1486-e242-45f1-8cc8-86f11d28a2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:17.169638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 672/1339] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Mar 8 14:43:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:17.178667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eeba4-af2c-4552-9711-28bc3a90431a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:17.180174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2a2eeba4-af2c-4552-9711-28bc3a90431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:17.278673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2eeba4-af2c-4552-9711-28bc3a90431a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:17.349306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:17.349873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:17.350152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:17.350426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:17.352026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:17.455491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:17.457376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dee2e-49cb-4a57-886f-b8ac762b2f55 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:17.476021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 668/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:20.627109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27aa9b-00c7-4727-91d4-cd78998519a8 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:20.627611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27aa9b-00c7-4727-91d4-cd78998519a8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:20.627611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27aa9b-00c7-4727-91d4-cd78998519a8 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:20.629349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 673/1341] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:20.634755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297af05b-b500-4ddb-96b6-a28e6f85329c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:20.635202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297af05b-b500-4ddb-96b6-a28e6f85329c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:20.635307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297af05b-b500-4ddb-96b6-a28e6f85329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:20.702877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-297af05b-b500-4ddb-96b6-a28e6f85329c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:20.704723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-297af05b-b500-4ddb-96b6-a28e6f85329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:20.801694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 669/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:43:20.838310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27aa9b-00c7-4727-91d4-cd78998519a8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:20.840404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fa27aa9b-00c7-4727-91d4-cd78998519a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:20.931236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27aa9b-00c7-4727-91d4-cd78998519a8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:20.934666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321407f6-825c-4681-8079-d72c83d545c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:20.935301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321407f6-825c-4681-8079-d72c83d545c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:20.935577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321407f6-825c-4681-8079-d72c83d545c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:20.935847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321407f6-825c-4681-8079-d72c83d545c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:20.945543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321407f6-825c-4681-8079-d72c83d545c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:20.947010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321407f6-825c-4681-8079-d72c83d545c1 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:20.956995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 674/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:25.230792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d3d3b-d028-4de9-8b9e-5891f4e7da6a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:25.231307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d3d3b-d028-4de9-8b9e-5891f4e7da6a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:25.231424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d3d3b-d028-4de9-8b9e-5891f4e7da6a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:25.233261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 670/1344] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:25.238866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b342-f97f-4262-abf1-7383423995b2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:25.239291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b342-f97f-4262-abf1-7383423995b2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:25.239486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b342-f97f-4262-abf1-7383423995b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:25.268103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f8c0b342-f97f-4262-abf1-7383423995b2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:25.269281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f8c0b342-f97f-4262-abf1-7383423995b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:25.342279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 675/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:25.382285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d3d3b-d028-4de9-8b9e-5891f4e7da6a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:25.384057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-274d3d3b-d028-4de9-8b9e-5891f4e7da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:25.397005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d3d3b-d028-4de9-8b9e-5891f4e7da6a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:25.400554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67322bfb-e6cd-402b-bb38-9a11377fa9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:25.401199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322bfb-e6cd-402b-bb38-9a11377fa9dd service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:25.401482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322bfb-e6cd-402b-bb38-9a11377fa9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:25.401759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67322bfb-e6cd-402b-bb38-9a11377fa9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:25.411341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67322bfb-e6cd-402b-bb38-9a11377fa9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:25.412789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67322bfb-e6cd-402b-bb38-9a11377fa9dd service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:25.422775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 671/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:28.496008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beffef-ea76-4bdb-bd01-4ebd8922f7be None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:28.496525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beffef-ea76-4bdb-bd01-4ebd8922f7be None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:28.496708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beffef-ea76-4bdb-bd01-4ebd8922f7be None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:28.498475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 676/1347] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:28.504262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d8d3c-700d-4a79-a346-f7f2d8f95c74 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:28.504717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d8d3c-700d-4a79-a346-f7f2d8f95c74 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:28.504839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d8d3c-700d-4a79-a346-f7f2d8f95c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:28.523161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-3a0d8d3c-700d-4a79-a346-f7f2d8f95c74 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:28.524327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3a0d8d3c-700d-4a79-a346-f7f2d8f95c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:28.532427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 672/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:28.569955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beffef-ea76-4bdb-bd01-4ebd8922f7be None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:28.580883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beffef-ea76-4bdb-bd01-4ebd8922f7be None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:28.584330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee9fc-8ea5-4570-b58c-4bdac7982505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:28.584965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee9fc-8ea5-4570-b58c-4bdac7982505 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:28.585271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee9fc-8ea5-4570-b58c-4bdac7982505 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:28.585543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee9fc-8ea5-4570-b58c-4bdac7982505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:28.594587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee9fc-8ea5-4570-b58c-4bdac7982505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:28.596012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee9fc-8ea5-4570-b58c-4bdac7982505 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:28.605257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 677/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:33.168709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e787afe-5761-4d22-bce9-5bb726ee5a75 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:33.169235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e787afe-5761-4d22-bce9-5bb726ee5a75 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:33.169235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e787afe-5761-4d22-bce9-5bb726ee5a75 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:33.171155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 673/1350] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:33.176353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26823-08c8-404c-b50b-a3f7a71d869e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:33.176761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26823-08c8-404c-b50b-a3f7a71d869e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:33.177024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26823-08c8-404c-b50b-a3f7a71d869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:33.195524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-18c26823-08c8-404c-b50b-a3f7a71d869e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:33.196703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-18c26823-08c8-404c-b50b-a3f7a71d869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:33.205411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 678/1351] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:33.243157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e787afe-5761-4d22-bce9-5bb726ee5a75 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:33.254212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e787afe-5761-4d22-bce9-5bb726ee5a75 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:33.257625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e4a1-df7a-4a27-81e0-7ba9893b644e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:33.258290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e4a1-df7a-4a27-81e0-7ba9893b644e service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:33.258570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e4a1-df7a-4a27-81e0-7ba9893b644e service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:33.258848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e4a1-df7a-4a27-81e0-7ba9893b644e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:33.268079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43e4a1-df7a-4a27-81e0-7ba9893b644e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:33.269498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43e4a1-df7a-4a27-81e0-7ba9893b644e service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:33.278826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 674/1352] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:38.495520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d4a7-4d2b-4e22-a7b3-ff1d0f8b4121 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:38.496365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d4a7-4d2b-4e22-a7b3-ff1d0f8b4121 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:38.496796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d4a7-4d2b-4e22-a7b3-ff1d0f8b4121 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:38.499006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 679/1353] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:43:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:38.514954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bb82-bf4f-48ca-9e95-ec393f3ffc4d None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:38.515499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bb82-bf4f-48ca-9e95-ec393f3ffc4d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:38.515581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bb82-bf4f-48ca-9e95-ec393f3ffc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:38.589764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-58a7bb82-bf4f-48ca-9e95-ec393f3ffc4d None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:38.591107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-58a7bb82-bf4f-48ca-9e95-ec393f3ffc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:38.672566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 675/1354] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:43:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:43.230722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb29a6-5db8-4c71-a8f7-2fa2a2df5168 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:43.231278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb29a6-5db8-4c71-a8f7-2fa2a2df5168 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:43.231566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb29a6-5db8-4c71-a8f7-2fa2a2df5168 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:43.233483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 680/1355] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:43.239695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ef4c-6830-418d-b655-0f284e8e7d99 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:43.240160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ef4c-6830-418d-b655-0f284e8e7d99 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:43.240462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ef4c-6830-418d-b655-0f284e8e7d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:43.260775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b8d9ef4c-6830-418d-b655-0f284e8e7d99 None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:43.262029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b8d9ef4c-6830-418d-b655-0f284e8e7d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:43.271005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 676/1356] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:44.645600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82a5d-3a2c-42d0-a8da-4f41b1f018af None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:44.646257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82a5d-3a2c-42d0-a8da-4f41b1f018af None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:44.646257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82a5d-3a2c-42d0-a8da-4f41b1f018af None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:44.647977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 681/1357] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:44.652953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c984d3-1907-42f3-8844-8bb42ec56e45 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:44.653393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c984d3-1907-42f3-8844-8bb42ec56e45 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:44.653496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c984d3-1907-42f3-8844-8bb42ec56e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:44.672015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-46c984d3-1907-42f3-8844-8bb42ec56e45 None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:44.673210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-46c984d3-1907-42f3-8844-8bb42ec56e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:44.681637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 677/1358] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:48.545878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3cee3-591d-426a-9ab8-c022c6908d6d None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:48.547015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3cee3-591d-426a-9ab8-c022c6908d6d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:48.547235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3cee3-591d-426a-9ab8-c022c6908d6d None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:48.549230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 682/1359] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:48.554295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134e66-d939-4022-9506-16ded08aeeb6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:48.554711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134e66-d939-4022-9506-16ded08aeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:48.554850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134e66-d939-4022-9506-16ded08aeeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:48.573391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6e134e66-d939-4022-9506-16ded08aeeb6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:48.574683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6e134e66-d939-4022-9506-16ded08aeeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:48.582773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 678/1360] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:48.629690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5674b-4c88-4d6d-9e2b-0d7be862202a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:48.630002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5674b-4c88-4d6d-9e2b-0d7be862202a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:48.630295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5674b-4c88-4d6d-9e2b-0d7be862202a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:48.632165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 683/1361] 10.222.0.30 () {54 vars in 961 bytes} [Tue Mar 8 14:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:48.637427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16517-3cb5-4b30-a010-87dd612b2d4e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:48.637834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16517-3cb5-4b30-a010-87dd612b2d4e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:48.638239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16517-3cb5-4b30-a010-87dd612b2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:48.686775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-afe16517-3cb5-4b30-a010-87dd612b2d4e None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:48.688769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-afe16517-3cb5-4b30-a010-87dd612b2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:48.778894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 679/1362] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Mar 8 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:48.787704 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5674b-4c88-4d6d-9e2b-0d7be862202a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:48.801911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5674b-4c88-4d6d-9e2b-0d7be862202a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:48.807264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d330-d38d-4f62-ad73-d2b802a4ab99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:48.807927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d330-d38d-4f62-ad73-d2b802a4ab99 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:48.808205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d330-d38d-4f62-ad73-d2b802a4ab99 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:48.808473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d330-d38d-4f62-ad73-d2b802a4ab99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:48.817503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d330-d38d-4f62-ad73-d2b802a4ab99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:48.819371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d330-d38d-4f62-ad73-d2b802a4ab99 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:48.831512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 684/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:51.383766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5491ef-9476-43d8-b38e-70a52667bf32 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:51.384293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5491ef-9476-43d8-b38e-70a52667bf32 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:51.384393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5491ef-9476-43d8-b38e-70a52667bf32 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:51.386235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 680/1364] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:51.392250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e185-3a42-40a0-9cb0-59dfd2fcce3b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:51.393108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e185-3a42-40a0-9cb0-59dfd2fcce3b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:51.393738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e185-3a42-40a0-9cb0-59dfd2fcce3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:51.412158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-77c1e185-3a42-40a0-9cb0-59dfd2fcce3b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:51.413625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-77c1e185-3a42-40a0-9cb0-59dfd2fcce3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:51.422523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 685/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:51.465636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5491ef-9476-43d8-b38e-70a52667bf32 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:51.482229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5491ef-9476-43d8-b38e-70a52667bf32 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:51.488475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffecab-866d-4c77-8e20-c835d131f015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:51.489365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffecab-866d-4c77-8e20-c835d131f015 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:51.489753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffecab-866d-4c77-8e20-c835d131f015 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:51.490288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffecab-866d-4c77-8e20-c835d131f015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:51.499117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffecab-866d-4c77-8e20-c835d131f015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:51.501710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffecab-866d-4c77-8e20-c835d131f015 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:51.511626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 681/1366] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:54.284969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec2f5-a86b-4511-9014-3a7077466faa None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:54.285484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec2f5-a86b-4511-9014-3a7077466faa None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:54.285594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec2f5-a86b-4511-9014-3a7077466faa None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:54.287344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 686/1367] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:54.292654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c59e-3747-4942-851f-62db6dcb72c1 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:54.293085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c59e-3747-4942-851f-62db6dcb72c1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:54.293242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c59e-3747-4942-851f-62db6dcb72c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:54.314591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6a18c59e-3747-4942-851f-62db6dcb72c1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:54.315842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6a18c59e-3747-4942-851f-62db6dcb72c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:54.324180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 682/1368] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:54.369470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282242d2-25be-4cd5-904a-2281f1870161 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:54.369763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282242d2-25be-4cd5-904a-2281f1870161 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:54.370089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282242d2-25be-4cd5-904a-2281f1870161 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:54.371849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 687/1369] 10.222.0.30 () {54 vars in 961 bytes} [Tue Mar 8 14:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:54.377099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11040f-fd89-493f-a124-20e99b0967a8 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:54.377498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11040f-fd89-493f-a124-20e99b0967a8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:54.377784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11040f-fd89-493f-a124-20e99b0967a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:54.402835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7c11040f-fd89-493f-a124-20e99b0967a8 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:54.404046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7c11040f-fd89-493f-a124-20e99b0967a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:54.416355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 683/1370] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Mar 8 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:43:54.426296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282242d2-25be-4cd5-904a-2281f1870161 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:54.441391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282242d2-25be-4cd5-904a-2281f1870161 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:54.447629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5426e-de36-4ac3-b479-01f9ad25eedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:54.448272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5426e-de36-4ac3-b479-01f9ad25eedd service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:54.448774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5426e-de36-4ac3-b479-01f9ad25eedd service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:54.449248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5426e-de36-4ac3-b479-01f9ad25eedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:54.459655 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5426e-de36-4ac3-b479-01f9ad25eedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:54.461510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5426e-de36-4ac3-b479-01f9ad25eedd service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:54.471745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 688/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:43:56.847671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38631fdb-07f6-4613-ac15-18f2aa9876be None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:56.848155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38631fdb-07f6-4613-ac15-18f2aa9876be None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:56.848248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38631fdb-07f6-4613-ac15-18f2aa9876be None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:56.850001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 684/1372] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:56.855302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdccb0b-de02-47f8-8c1f-82cbe81950dc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:56.855742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdccb0b-de02-47f8-8c1f-82cbe81950dc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:56.855839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdccb0b-de02-47f8-8c1f-82cbe81950dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:56.874308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8fdccb0b-de02-47f8-8c1f-82cbe81950dc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:56.876410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8fdccb0b-de02-47f8-8c1f-82cbe81950dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:56.884387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 689/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:56.903923 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f439d-6fe1-4fb6-a043-84e718ffb7cc None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:56.904213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f439d-6fe1-4fb6-a043-84e718ffb7cc None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:56.904664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f439d-6fe1-4fb6-a043-84e718ffb7cc None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:56.910241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 685/1374] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:56.912395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84951cc-b7d9-40b8-b327-b83608ae5585 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:56.912685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84951cc-b7d9-40b8-b327-b83608ae5585 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:56.913081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84951cc-b7d9-40b8-b327-b83608ae5585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:56.928772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f439d-6fe1-4fb6-a043-84e718ffb7cc None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:56.933161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f84951cc-b7d9-40b8-b327-b83608ae5585 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:56.934391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f84951cc-b7d9-40b8-b327-b83608ae5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:56.943675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 690/1375] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:56.943846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f439d-6fe1-4fb6-a043-84e718ffb7cc None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:56.949466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f0a07-8569-48bb-b3db-6ebb9533fbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:56.950140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f0a07-8569-48bb-b3db-6ebb9533fbcb service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:56.950420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f0a07-8569-48bb-b3db-6ebb9533fbcb service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:56.950697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f0a07-8569-48bb-b3db-6ebb9533fbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:56.959656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f0a07-8569-48bb-b3db-6ebb9533fbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:56.961234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f0a07-8569-48bb-b3db-6ebb9533fbcb service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:56.971565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 686/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:43:57.246304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6e3e-5f7a-47d0-a815-2e4b48d2a4c1 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:57.246304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6e3e-5f7a-47d0-a815-2e4b48d2a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:57.246304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6e3e-5f7a-47d0-a815-2e4b48d2a4c1 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:57.249891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 691/1377] 10.222.0.30 () {54 vars in 963 bytes} [Tue Mar 8 14:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:57.253311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabd4b-ada9-424a-9f97-501d76dcc743 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:57.253701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabd4b-ada9-424a-9f97-501d76dcc743 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:57.254100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabd4b-ada9-424a-9f97-501d76dcc743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:57.313044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0ddabd4b-ada9-424a-9f97-501d76dcc743 None None] MFA Rules not processed for user `faa371f194b149bd86f53b5de40bb719`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:57.314480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0ddabd4b-ada9-424a-9f97-501d76dcc743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:57.379128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 687/1378] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Mar 8 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:57.387270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a6e3e-5f7a-47d0-a815-2e4b48d2a4c1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:57.398389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a6e3e-5f7a-47d0-a815-2e4b48d2a4c1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:57.402294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05962288-6bc0-4607-91b4-3ddede92005b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:57.402934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962288-6bc0-4607-91b4-3ddede92005b service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:57.403219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962288-6bc0-4607-91b4-3ddede92005b service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:57.403547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05962288-6bc0-4607-91b4-3ddede92005b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:57.413240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05962288-6bc0-4607-91b4-3ddede92005b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:57.414714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05962288-6bc0-4607-91b4-3ddede92005b service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:57.424894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 692/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:43:59.353312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288178-645e-4f03-ae06-7fcb29ff9de5 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:59.353929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288178-645e-4f03-ae06-7fcb29ff9de5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:59.353929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb288178-645e-4f03-ae06-7fcb29ff9de5 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:59.355733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 688/1380] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:43:59.362235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9362-86c5-42a6-bf1d-40f55b9ceb63 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:59.362697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9362-86c5-42a6-bf1d-40f55b9ceb63 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:59.362697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9362-86c5-42a6-bf1d-40f55b9ceb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:59.381297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f4ba9362-86c5-42a6-bf1d-40f55b9ceb63 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:43:59.382514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f4ba9362-86c5-42a6-bf1d-40f55b9ceb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:43:59.391790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 693/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:43:59.436121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288178-645e-4f03-ae06-7fcb29ff9de5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:43:59.450695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb288178-645e-4f03-ae06-7fcb29ff9de5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:43:59.456312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b8f5-5427-4d56-b6e9-92830610593c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:43:59.456946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b8f5-5427-4d56-b6e9-92830610593c service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:43:59.457226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b8f5-5427-4d56-b6e9-92830610593c service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:43:59.457500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b8f5-5427-4d56-b6e9-92830610593c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:43:59.466151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b8f5-5427-4d56-b6e9-92830610593c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:43:59.467766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b8f5-5427-4d56-b6e9-92830610593c service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:43:59.477816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 689/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:01.862118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841533b-a2e3-4b55-9bae-98e17440a565 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:01.862658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841533b-a2e3-4b55-9bae-98e17440a565 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:01.862658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841533b-a2e3-4b55-9bae-98e17440a565 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:01.864457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 694/1383] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:01.869689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61955f6-064b-4e48-964d-a98b66d67b89 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:01.870115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61955f6-064b-4e48-964d-a98b66d67b89 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:01.870301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61955f6-064b-4e48-964d-a98b66d67b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:01.888546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a61955f6-064b-4e48-964d-a98b66d67b89 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:01.889930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a61955f6-064b-4e48-964d-a98b66d67b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:01.897709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 690/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:01.948272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841533b-a2e3-4b55-9bae-98e17440a565 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:01.962448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841533b-a2e3-4b55-9bae-98e17440a565 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:01.968507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ddbb-63c5-46d5-bf9f-f5aea336b249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:01.969224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ddbb-63c5-46d5-bf9f-f5aea336b249 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:01.969506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ddbb-63c5-46d5-bf9f-f5aea336b249 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:01.969828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ddbb-63c5-46d5-bf9f-f5aea336b249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:01.980102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5ddbb-63c5-46d5-bf9f-f5aea336b249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:01.981748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5ddbb-63c5-46d5-bf9f-f5aea336b249 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:01.991973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 695/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:04.428936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b3d4-ef55-43af-b9b3-451966e90098 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:04.429435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b3d4-ef55-43af-b9b3-451966e90098 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:04.429435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b3d4-ef55-43af-b9b3-451966e90098 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:04.431186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 691/1386] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:44:04.436801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115ce7-4216-4339-99a9-d39ffa1590c0 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:04.437238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115ce7-4216-4339-99a9-d39ffa1590c0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:04.437408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115ce7-4216-4339-99a9-d39ffa1590c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:04.455077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e0115ce7-4216-4339-99a9-d39ffa1590c0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:04.456299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e0115ce7-4216-4339-99a9-d39ffa1590c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:04.464069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 696/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:04.506004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b3d4-ef55-43af-b9b3-451966e90098 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:04.522301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b3d4-ef55-43af-b9b3-451966e90098 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:04.527905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa5931-3874-43af-81a1-2f25f84b3d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:04.528649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa5931-3874-43af-81a1-2f25f84b3d48 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:04.529054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa5931-3874-43af-81a1-2f25f84b3d48 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:04.529695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa5931-3874-43af-81a1-2f25f84b3d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:04.538977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa5931-3874-43af-81a1-2f25f84b3d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:04.541071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa5931-3874-43af-81a1-2f25f84b3d48 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:04.552247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 692/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:06.964916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e37f-4884-4c4f-9dca-37c68ce5fa52 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:06.965426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e37f-4884-4c4f-9dca-37c68ce5fa52 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:06.965548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e37f-4884-4c4f-9dca-37c68ce5fa52 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:06.967282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 697/1389] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:44:06.972579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01ab1-616c-4b86-a694-35d5f035d592 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:06.973390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01ab1-616c-4b86-a694-35d5f035d592 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:06.973775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01ab1-616c-4b86-a694-35d5f035d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:06.992711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-caa01ab1-616c-4b86-a694-35d5f035d592 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:06.993920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-caa01ab1-616c-4b86-a694-35d5f035d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:07.003404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 693/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:07.050649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415e37f-4884-4c4f-9dca-37c68ce5fa52 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:07.065646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415e37f-4884-4c4f-9dca-37c68ce5fa52 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:07.071319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff358-d434-4768-941b-790d6b6c7d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:07.076122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff358-d434-4768-941b-790d6b6c7d38 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:07.076407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff358-d434-4768-941b-790d6b6c7d38 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:07.076685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff358-d434-4768-941b-790d6b6c7d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:07.088970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff358-d434-4768-941b-790d6b6c7d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:07.090523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff358-d434-4768-941b-790d6b6c7d38 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:07.100262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 698/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:09.446593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492849-26b6-4a39-8e3c-8cd3b907493b None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:09.447156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492849-26b6-4a39-8e3c-8cd3b907493b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:09.447346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492849-26b6-4a39-8e3c-8cd3b907493b None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:09.449721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 694/1392] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:09.456479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604f71-4f02-4aa5-8613-9050a8dbf551 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:09.456920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604f71-4f02-4aa5-8613-9050a8dbf551 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:09.457177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604f71-4f02-4aa5-8613-9050a8dbf551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:09.478209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0b604f71-4f02-4aa5-8613-9050a8dbf551 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:09.479532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0b604f71-4f02-4aa5-8613-9050a8dbf551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:09.489187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 699/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:09.539011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492849-26b6-4a39-8e3c-8cd3b907493b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:09.557908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492849-26b6-4a39-8e3c-8cd3b907493b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:09.565900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290c3f2-6fcd-47e9-a91a-e46ea218cae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:09.566703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290c3f2-6fcd-47e9-a91a-e46ea218cae3 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:09.567042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290c3f2-6fcd-47e9-a91a-e46ea218cae3 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:09.567391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290c3f2-6fcd-47e9-a91a-e46ea218cae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:09.578050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290c3f2-6fcd-47e9-a91a-e46ea218cae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:09.580039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290c3f2-6fcd-47e9-a91a-e46ea218cae3 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:09.592011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 695/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:12.053205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79475b-b9c6-4748-8e5e-164edb7051ee None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:12.053803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79475b-b9c6-4748-8e5e-164edb7051ee None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:12.053803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79475b-b9c6-4748-8e5e-164edb7051ee None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:12.055596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 700/1395] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:12.060951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12ecfb-0ed0-4429-b7f3-3550a483d225 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:12.061397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12ecfb-0ed0-4429-b7f3-3550a483d225 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:12.061618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12ecfb-0ed0-4429-b7f3-3550a483d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:12.080650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-af12ecfb-0ed0-4429-b7f3-3550a483d225 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:12.081974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-af12ecfb-0ed0-4429-b7f3-3550a483d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:12.090223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 696/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:12.133724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79475b-b9c6-4748-8e5e-164edb7051ee None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:12.148276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79475b-b9c6-4748-8e5e-164edb7051ee None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:12.153660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966e327-f19c-493d-ad43-2e40e0ccc32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:12.154333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966e327-f19c-493d-ad43-2e40e0ccc32f service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:12.154613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966e327-f19c-493d-ad43-2e40e0ccc32f service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:12.154887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966e327-f19c-493d-ad43-2e40e0ccc32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:12.163104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966e327-f19c-493d-ad43-2e40e0ccc32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:12.164821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966e327-f19c-493d-ad43-2e40e0ccc32f service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:12.174279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 701/1397] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:13.376944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb771f5-6d54-4ed0-ae2f-03590503d606 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:13.377529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb771f5-6d54-4ed0-ae2f-03590503d606 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:13.377529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb771f5-6d54-4ed0-ae2f-03590503d606 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:13.379299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 697/1398] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:13.384651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a852c-96df-44c3-b9d0-69dc181e42f2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:13.385083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a852c-96df-44c3-b9d0-69dc181e42f2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:13.385216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a852c-96df-44c3-b9d0-69dc181e42f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:13.403013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-9f3a852c-96df-44c3-b9d0-69dc181e42f2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:13.404195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9f3a852c-96df-44c3-b9d0-69dc181e42f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:13.427519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 702/1399] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:13.495820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3821-d74e-4020-accc-5b4180d4c19a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:13.496101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3821-d74e-4020-accc-5b4180d4c19a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:13.496559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be3821-d74e-4020-accc-5b4180d4c19a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:13.498508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 698/1400] 10.222.0.30 () {54 vars in 961 bytes} [Tue Mar 8 14:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:13.504094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab8410-0a9a-4321-8190-efa6a57ec3b6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:13.504454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab8410-0a9a-4321-8190-efa6a57ec3b6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:13.504810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab8410-0a9a-4321-8190-efa6a57ec3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:13.556807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-fbab8410-0a9a-4321-8190-efa6a57ec3b6 None None] MFA Rules not processed for user `8a7848c76d664adc9df92ab214c0c7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:13.558048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fbab8410-0a9a-4321-8190-efa6a57ec3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:13.620841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 703/1401] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Mar 8 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:13.629779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be3821-d74e-4020-accc-5b4180d4c19a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:13.642542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be3821-d74e-4020-accc-5b4180d4c19a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:13.646520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8081fb7-20a4-48a5-abbe-a9a4fd00aabf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:13.647378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081fb7-20a4-48a5-abbe-a9a4fd00aabf service glance] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:13.647870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081fb7-20a4-48a5-abbe-a9a4fd00aabf service glance] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:13.648436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8081fb7-20a4-48a5-abbe-a9a4fd00aabf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:13.659464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8081fb7-20a4-48a5-abbe-a9a4fd00aabf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:13.661572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8081fb7-20a4-48a5-abbe-a9a4fd00aabf service glance] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:13.673560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 699/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:14.104132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a75175-b0d4-4022-aaf1-45a4c66fe0b4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.104491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a75175-b0d4-4022-aaf1-45a4c66fe0b4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.104833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a75175-b0d4-4022-aaf1-45a4c66fe0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.154132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-55a75175-b0d4-4022-aaf1-45a4c66fe0b4 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:14.155279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-55a75175-b0d4-4022-aaf1-45a4c66fe0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:14.219164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 704/1403] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:14.259899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d913d1-6dfe-4578-94d1-1e75449517c4 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.260185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d913d1-6dfe-4578-94d1-1e75449517c4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.260456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d913d1-6dfe-4578-94d1-1e75449517c4 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.262262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 700/1404] 10.222.0.30 () {54 vars in 942 bytes} [Tue Mar 8 14:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:14.269436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33b942-2e1d-44df-a6ac-92080333053e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.269796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33b942-2e1d-44df-a6ac-92080333053e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.270202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33b942-2e1d-44df-a6ac-92080333053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.317040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-cb33b942-2e1d-44df-a6ac-92080333053e None None] MFA Rules not processed for user `e5b56d7d7db04439a40f4a02b9ad8135`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:14.318273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cb33b942-2e1d-44df-a6ac-92080333053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:14.393207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 705/1405] 10.222.0.30 () {58 vars in 1039 bytes} [Tue Mar 8 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:14.402696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d913d1-6dfe-4578-94d1-1e75449517c4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:14.416292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d913d1-6dfe-4578-94d1-1e75449517c4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:14.421043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3016-ebd0-4a28-befc-e98e11775644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:14.421951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3016-ebd0-4a28-befc-e98e11775644 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.422301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3016-ebd0-4a28-befc-e98e11775644 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.422645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3016-ebd0-4a28-befc-e98e11775644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.430898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc3016-ebd0-4a28-befc-e98e11775644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:14.432487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc3016-ebd0-4a28-befc-e98e11775644 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:14.441215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 701/1406] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:44:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:44:14.512888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708fd5-cbe9-4396-86ca-d05ce48cc037 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.513171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708fd5-cbe9-4396-86ca-d05ce48cc037 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.513446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02708fd5-cbe9-4396-86ca-d05ce48cc037 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.516275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 706/1407] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:14.522103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8f7c-8ecb-40a4-ae6a-687556bc5af0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.522915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8f7c-8ecb-40a4-ae6a-687556bc5af0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.522915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8f7c-8ecb-40a4-ae6a-687556bc5af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.550821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c88d8f7c-8ecb-40a4-ae6a-687556bc5af0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:14.552131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c88d8f7c-8ecb-40a4-ae6a-687556bc5af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:14.560212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 702/1408] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:14.605068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708fd5-cbe9-4396-86ca-d05ce48cc037 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:14.623169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02708fd5-cbe9-4396-86ca-d05ce48cc037 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:14.629773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ae60e-866d-4e1a-a935-ed1b4947bf3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:14.630491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae60e-866d-4e1a-a935-ed1b4947bf3b service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:14.630999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae60e-866d-4e1a-a935-ed1b4947bf3b service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:14.631330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae60e-866d-4e1a-a935-ed1b4947bf3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:14.640479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae60e-866d-4e1a-a935-ed1b4947bf3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:14.642411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae60e-866d-4e1a-a935-ed1b4947bf3b service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:14.654600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 707/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:17.125119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fbbe3-e0c3-4d0b-a551-48d33654c161 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:17.125645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fbbe3-e0c3-4d0b-a551-48d33654c161 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:17.125645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fbbe3-e0c3-4d0b-a551-48d33654c161 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:17.127538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 703/1410] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:17.132986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18dc80-3bea-49ab-a101-61e378572b39 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:17.133427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18dc80-3bea-49ab-a101-61e378572b39 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:17.135521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18dc80-3bea-49ab-a101-61e378572b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:17.152334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7a18dc80-3bea-49ab-a101-61e378572b39 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:17.153829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7a18dc80-3bea-49ab-a101-61e378572b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:17.164131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 708/1411] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:17.215219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fbbe3-e0c3-4d0b-a551-48d33654c161 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:17.230197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fbbe3-e0c3-4d0b-a551-48d33654c161 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:17.236620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe852-3118-4f70-be5f-7645439d25c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:17.237258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe852-3118-4f70-be5f-7645439d25c8 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:17.237543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe852-3118-4f70-be5f-7645439d25c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:17.237821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe852-3118-4f70-be5f-7645439d25c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:17.248070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe852-3118-4f70-be5f-7645439d25c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:17.248279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe852-3118-4f70-be5f-7645439d25c8 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:17.258834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 704/1412] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:37.490315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c755-a7d2-4038-b4f2-83138d943a9c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:37.490958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c755-a7d2-4038-b4f2-83138d943a9c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:37.490958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0c755-a7d2-4038-b4f2-83138d943a9c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:37.492622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 709/1413] 10.222.0.30 () {54 vars in 918 bytes} [Tue Mar 8 14:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:37.497656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0c930-32a2-41df-b547-c849ac933327 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:37.498112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0c930-32a2-41df-b547-c849ac933327 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:37.498278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0c930-32a2-41df-b547-c849ac933327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:37.516378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c0d0c930-32a2-41df-b547-c849ac933327 None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:37.517556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c0d0c930-32a2-41df-b547-c849ac933327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:37.525998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 705/1414] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Mar 8 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:37.540744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831529c-44bc-490e-bc85-6071bce03d78 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:37.541027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831529c-44bc-490e-bc85-6071bce03d78 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:37.541303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831529c-44bc-490e-bc85-6071bce03d78 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:37.543061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 710/1415] 10.222.0.30 () {54 vars in 918 bytes} [Tue Mar 8 14:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:37.548121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11acabc-2b33-4e8d-9bf0-7aa4f0400771 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:37.548415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11acabc-2b33-4e8d-9bf0-7aa4f0400771 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:37.548702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11acabc-2b33-4e8d-9bf0-7aa4f0400771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:37.566416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e11acabc-2b33-4e8d-9bf0-7aa4f0400771 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:37.567627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e11acabc-2b33-4e8d-9bf0-7aa4f0400771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:37.576781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 706/1416] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Mar 8 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:40.315052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab0a0-5577-4218-8582-315aa320d783 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:40.315630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab0a0-5577-4218-8582-315aa320d783 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:40.315630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab0a0-5577-4218-8582-315aa320d783 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:40.317368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:40.322828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b00ed-b711-4ddf-8e5d-f70de41e4ceb None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:40.323262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b00ed-b711-4ddf-8e5d-f70de41e4ceb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:40.323449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b00ed-b711-4ddf-8e5d-f70de41e4ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:40.341438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-528b00ed-b711-4ddf-8e5d-f70de41e4ceb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:40.343289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-528b00ed-b711-4ddf-8e5d-f70de41e4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:40.351007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:40.391426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ab0a0-5577-4218-8582-315aa320d783 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:40.407435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ab0a0-5577-4218-8582-315aa320d783 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:40.412760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8872-a915-4861-abf4-7c3a3fe735e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:40.413388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8872-a915-4861-abf4-7c3a3fe735e1 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:40.413666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8872-a915-4861-abf4-7c3a3fe735e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:40.413968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8872-a915-4861-abf4-7c3a3fe735e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:40.421865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8872-a915-4861-abf4-7c3a3fe735e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:40.423445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8872-a915-4861-abf4-7c3a3fe735e1 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:40.432443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 712/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:41.783883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697f08-4ab5-4df9-9448-1e3aa4ad32d5 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:41.784451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697f08-4ab5-4df9-9448-1e3aa4ad32d5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:41.784451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697f08-4ab5-4df9-9448-1e3aa4ad32d5 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:41.786304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:41.791171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71084-fbb7-43ad-8847-e8d156ba6d3c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:41.791561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71084-fbb7-43ad-8847-e8d156ba6d3c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:41.791718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71084-fbb7-43ad-8847-e8d156ba6d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:41.811980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b2b71084-fbb7-43ad-8847-e8d156ba6d3c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:41.813624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b2b71084-fbb7-43ad-8847-e8d156ba6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:41.821693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:41.998053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697f08-4ab5-4df9-9448-1e3aa4ad32d5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:42.012038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697f08-4ab5-4df9-9448-1e3aa4ad32d5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:42.017394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802fa2f-733b-4cd9-b075-854eb8d39ba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:42.018154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802fa2f-733b-4cd9-b075-854eb8d39ba5 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:42.018441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802fa2f-733b-4cd9-b075-854eb8d39ba5 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:42.018717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802fa2f-733b-4cd9-b075-854eb8d39ba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:42.026462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802fa2f-733b-4cd9-b075-854eb8d39ba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:42.028056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802fa2f-733b-4cd9-b075-854eb8d39ba5 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:42.037659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 709/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:43.355182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210270ea-d997-4316-92a3-fcabec5e6f98 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:43.355781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210270ea-d997-4316-92a3-fcabec5e6f98 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:43.355781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210270ea-d997-4316-92a3-fcabec5e6f98 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:43.357508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:43.363184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743d305-a5a0-4b78-9ada-4709666ae1a9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:43.363579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743d305-a5a0-4b78-9ada-4709666ae1a9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:43.363800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743d305-a5a0-4b78-9ada-4709666ae1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:43.382940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a743d305-a5a0-4b78-9ada-4709666ae1a9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:43.384137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a743d305-a5a0-4b78-9ada-4709666ae1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:43.392308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:43.543527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210270ea-d997-4316-92a3-fcabec5e6f98 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:43.558025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210270ea-d997-4316-92a3-fcabec5e6f98 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:43.563341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9db32-3f64-444e-a49c-7b9d4df9aef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:43.563978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9db32-3f64-444e-a49c-7b9d4df9aef8 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:43.564259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9db32-3f64-444e-a49c-7b9d4df9aef8 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:43.564533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9db32-3f64-444e-a49c-7b9d4df9aef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:43.572579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9db32-3f64-444e-a49c-7b9d4df9aef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:43.574209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9db32-3f64-444e-a49c-7b9d4df9aef8 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:43.583405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 715/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:44.915587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4160-edc2-4d6c-ad7b-f1fc6ea88cf1 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:44.916110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4160-edc2-4d6c-ad7b-f1fc6ea88cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:44.916221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4160-edc2-4d6c-ad7b-f1fc6ea88cf1 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:44.918079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:44.923656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f970e-d763-4126-aaf7-a891301d5925 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:44.924096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f970e-d763-4126-aaf7-a891301d5925 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:44.924214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f970e-d763-4126-aaf7-a891301d5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:44.942739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-212f970e-d763-4126-aaf7-a891301d5925 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:44.944194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-212f970e-d763-4126-aaf7-a891301d5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:44.954040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:45.104563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4160-edc2-4d6c-ad7b-f1fc6ea88cf1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:45.118424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4160-edc2-4d6c-ad7b-f1fc6ea88cf1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:45.123654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e4f55-999c-4385-bee9-17c7d34b7685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:45.125075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f55-999c-4385-bee9-17c7d34b7685 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:45.125350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f55-999c-4385-bee9-17c7d34b7685 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:45.125619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f55-999c-4385-bee9-17c7d34b7685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:45.133538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e4f55-999c-4385-bee9-17c7d34b7685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:45.135135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e4f55-999c-4385-bee9-17c7d34b7685 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:45.145044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 712/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:46.456612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3d21-eb8c-4456-996c-d391390a2157 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:46.457155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3d21-eb8c-4456-996c-d391390a2157 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:46.457155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3d21-eb8c-4456-996c-d391390a2157 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:46.459032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:46.463974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7d71-7094-4516-9bcb-b0e6a00af903 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:46.464398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7d71-7094-4516-9bcb-b0e6a00af903 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:46.464526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7d71-7094-4516-9bcb-b0e6a00af903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:46.482868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6adc7d71-7094-4516-9bcb-b0e6a00af903 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:46.484779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6adc7d71-7094-4516-9bcb-b0e6a00af903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:46.492380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:46.640831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e3d21-eb8c-4456-996c-d391390a2157 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:46.654675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e3d21-eb8c-4456-996c-d391390a2157 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:46.660021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34ac46-1d5d-48e0-b813-06e83a6c1e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:46.660649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34ac46-1d5d-48e0-b813-06e83a6c1e5f service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:46.660927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34ac46-1d5d-48e0-b813-06e83a6c1e5f service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:46.661199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34ac46-1d5d-48e0-b813-06e83a6c1e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:46.668984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34ac46-1d5d-48e0-b813-06e83a6c1e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:46.670778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34ac46-1d5d-48e0-b813-06e83a6c1e5f service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:46.679841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 718/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:47.928078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5994540-e78a-4152-8f62-64c22624cb98 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:47.928610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5994540-e78a-4152-8f62-64c22624cb98 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:47.928610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5994540-e78a-4152-8f62-64c22624cb98 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:47.930415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:47.935387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8557d4-f43c-44ab-91c8-097db13329c8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:47.935839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8557d4-f43c-44ab-91c8-097db13329c8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:47.935924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8557d4-f43c-44ab-91c8-097db13329c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:47.956584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6a8557d4-f43c-44ab-91c8-097db13329c8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:47.957808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6a8557d4-f43c-44ab-91c8-097db13329c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:47.965685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:48.119797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5994540-e78a-4152-8f62-64c22624cb98 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:48.134187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5994540-e78a-4152-8f62-64c22624cb98 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:48.139309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192460a1-89df-4105-841b-5565243b1c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:48.140740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192460a1-89df-4105-841b-5565243b1c44 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:48.141021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192460a1-89df-4105-841b-5565243b1c44 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:48.141294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192460a1-89df-4105-841b-5565243b1c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:48.149042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192460a1-89df-4105-841b-5565243b1c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:48.150640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192460a1-89df-4105-841b-5565243b1c44 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:48.159802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 715/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:49.412850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc70155-cb1f-48d3-8554-32427f83c8b7 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:49.413424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc70155-cb1f-48d3-8554-32427f83c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:49.413424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc70155-cb1f-48d3-8554-32427f83c8b7 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:49.415259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:49.420303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5293521-e0cd-4690-8c5e-170ccc701aff None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:49.421724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5293521-e0cd-4690-8c5e-170ccc701aff None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:49.422055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5293521-e0cd-4690-8c5e-170ccc701aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:49.439800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b5293521-e0cd-4690-8c5e-170ccc701aff None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:49.440983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b5293521-e0cd-4690-8c5e-170ccc701aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:49.449017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:49.599601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc70155-cb1f-48d3-8554-32427f83c8b7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:49.614474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc70155-cb1f-48d3-8554-32427f83c8b7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:49.619685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595d5f-ac75-47f5-9884-00b70405f272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:49.620309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595d5f-ac75-47f5-9884-00b70405f272 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:49.620585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595d5f-ac75-47f5-9884-00b70405f272 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:49.620856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595d5f-ac75-47f5-9884-00b70405f272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:49.628862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595d5f-ac75-47f5-9884-00b70405f272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:49.630558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595d5f-ac75-47f5-9884-00b70405f272 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:49.639735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 721/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:50.891342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918784b-14fb-49bc-8542-ba36ffc17d00 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:50.891792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918784b-14fb-49bc-8542-ba36ffc17d00 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:50.891891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918784b-14fb-49bc-8542-ba36ffc17d00 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:50.893679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:50.898518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455417-0c62-4b40-b469-174808b1a5cc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:50.898939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455417-0c62-4b40-b469-174808b1a5cc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:50.899065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63455417-0c62-4b40-b469-174808b1a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:50.917090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-63455417-0c62-4b40-b469-174808b1a5cc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:50.918309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-63455417-0c62-4b40-b469-174808b1a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:50.926664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:44:51.077674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918784b-14fb-49bc-8542-ba36ffc17d00 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:51.091565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918784b-14fb-49bc-8542-ba36ffc17d00 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:51.097646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1c80b-25c6-4834-9735-563373efb516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:51.098302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c80b-25c6-4834-9735-563373efb516 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:51.098584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c80b-25c6-4834-9735-563373efb516 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:51.098858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c80b-25c6-4834-9735-563373efb516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:51.106797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1c80b-25c6-4834-9735-563373efb516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:51.109384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1c80b-25c6-4834-9735-563373efb516 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:51.119150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 718/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:52.365390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd5ab-a609-4f4a-b07e-f0d3f4c3548b None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:52.365976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd5ab-a609-4f4a-b07e-f0d3f4c3548b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:52.365976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd5ab-a609-4f4a-b07e-f0d3f4c3548b None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:52.367731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:52.372704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e28c-eaaf-424b-a714-bffcbbdf11fb None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:52.373128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e28c-eaaf-424b-a714-bffcbbdf11fb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:52.373269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e28c-eaaf-424b-a714-bffcbbdf11fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:52.391993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7734e28c-eaaf-424b-a714-bffcbbdf11fb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:52.393186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7734e28c-eaaf-424b-a714-bffcbbdf11fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:52.400871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:52.556470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd5ab-a609-4f4a-b07e-f0d3f4c3548b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:52.570876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd5ab-a609-4f4a-b07e-f0d3f4c3548b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:52.576156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11ea3-2a92-43fb-91f1-bee82ef8710d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:52.576808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11ea3-2a92-43fb-91f1-bee82ef8710d service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:52.577178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11ea3-2a92-43fb-91f1-bee82ef8710d service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:52.577458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11ea3-2a92-43fb-91f1-bee82ef8710d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:52.585226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11ea3-2a92-43fb-91f1-bee82ef8710d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:52.586842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11ea3-2a92-43fb-91f1-bee82ef8710d service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:52.596684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 724/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:54.825195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8329-209e-4ade-a910-f4009a28350c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:54.826109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8329-209e-4ade-a910-f4009a28350c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:54.826109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8329-209e-4ade-a910-f4009a28350c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:54.827639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:54.834474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468bfb-5914-4d09-827d-31afe97283b9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:54.834933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468bfb-5914-4d09-827d-31afe97283b9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:54.835027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468bfb-5914-4d09-827d-31afe97283b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:54.853152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8f468bfb-5914-4d09-827d-31afe97283b9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:54.854390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8f468bfb-5914-4d09-827d-31afe97283b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:54.862921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:54.910284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8329-209e-4ade-a910-f4009a28350c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:54.922962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8329-209e-4ade-a910-f4009a28350c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:54.928305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a232f-a659-484d-95aa-27c468936a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:54.928944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a232f-a659-484d-95aa-27c468936a56 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:54.929224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a232f-a659-484d-95aa-27c468936a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:54.929500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a232f-a659-484d-95aa-27c468936a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:54.942557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a232f-a659-484d-95aa-27c468936a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:54.945237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a232f-a659-484d-95aa-27c468936a56 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:54.957154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 721/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:57.416999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bceb79-c9c4-4284-aad6-ef9596519f82 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:57.417602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bceb79-c9c4-4284-aad6-ef9596519f82 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:57.417602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bceb79-c9c4-4284-aad6-ef9596519f82 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:57.419392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:44:57.425422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d978f-5922-46db-a502-5d106f71dda9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:57.425896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d978f-5922-46db-a502-5d106f71dda9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:57.426018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d978f-5922-46db-a502-5d106f71dda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:57.444444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f11d978f-5922-46db-a502-5d106f71dda9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:44:57.445634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f11d978f-5922-46db-a502-5d106f71dda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:44:57.453512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:44:57.491682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bceb79-c9c4-4284-aad6-ef9596519f82 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:44:57.503433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bceb79-c9c4-4284-aad6-ef9596519f82 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:44:57.506896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91699f-3f9c-45b2-9bef-14a9b5ee51ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:44:57.507522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91699f-3f9c-45b2-9bef-14a9b5ee51ac service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:44:57.507802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91699f-3f9c-45b2-9bef-14a9b5ee51ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:44:57.508075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91699f-3f9c-45b2-9bef-14a9b5ee51ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:44:57.517059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91699f-3f9c-45b2-9bef-14a9b5ee51ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:44:57.518545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91699f-3f9c-45b2-9bef-14a9b5ee51ac service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:44:57.527492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 727/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:00.223492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b17cb1-f96b-422b-b8d0-2cf06db93ba5 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:00.224051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b17cb1-f96b-422b-b8d0-2cf06db93ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:00.224051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b17cb1-f96b-422b-b8d0-2cf06db93ba5 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:00.225724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:00.230997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7f09-887b-4246-b841-0d07ded5995c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:00.231452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7f09-887b-4246-b841-0d07ded5995c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:00.231572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7f09-887b-4246-b841-0d07ded5995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:00.249472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f5ae7f09-887b-4246-b841-0d07ded5995c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:00.250681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f5ae7f09-887b-4246-b841-0d07ded5995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:00.258279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:00.298585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b17cb1-f96b-422b-b8d0-2cf06db93ba5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:00.309083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b17cb1-f96b-422b-b8d0-2cf06db93ba5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:00.312571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76fef-b3c4-4073-bd3b-f85bf2d55579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:00.313191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76fef-b3c4-4073-bd3b-f85bf2d55579 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:00.313469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76fef-b3c4-4073-bd3b-f85bf2d55579 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:00.313739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76fef-b3c4-4073-bd3b-f85bf2d55579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:00.322472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76fef-b3c4-4073-bd3b-f85bf2d55579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:00.323886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76fef-b3c4-4073-bd3b-f85bf2d55579 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:00.333469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 724/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:02.777793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0718-3620-4801-a325-9268855d9175 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:02.778402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0718-3620-4801-a325-9268855d9175 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:02.778402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0718-3620-4801-a325-9268855d9175 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:02.780831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:02.786178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59a279-8dbd-48d0-9a5a-1e18ac514198 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:02.786608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59a279-8dbd-48d0-9a5a-1e18ac514198 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:02.786766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59a279-8dbd-48d0-9a5a-1e18ac514198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:02.804010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-dd59a279-8dbd-48d0-9a5a-1e18ac514198 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:02.805191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dd59a279-8dbd-48d0-9a5a-1e18ac514198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:02.813140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:45:02.851857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0718-3620-4801-a325-9268855d9175 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:02.862957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0718-3620-4801-a325-9268855d9175 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:02.866596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee4f3e-368a-4469-b064-03ecfc5d8c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:02.867246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee4f3e-368a-4469-b064-03ecfc5d8c34 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:02.867521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee4f3e-368a-4469-b064-03ecfc5d8c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:02.867792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee4f3e-368a-4469-b064-03ecfc5d8c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:02.876604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee4f3e-368a-4469-b064-03ecfc5d8c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:02.877961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee4f3e-368a-4469-b064-03ecfc5d8c34 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:02.887105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 730/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:05.222097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96481-38dc-4775-bd51-272806b959d3 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:05.222658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96481-38dc-4775-bd51-272806b959d3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:05.222658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96481-38dc-4775-bd51-272806b959d3 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:05.224313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:05.229630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914ac8e-d52b-482f-b8e6-6131efaef61d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:05.230085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914ac8e-d52b-482f-b8e6-6131efaef61d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:05.230215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914ac8e-d52b-482f-b8e6-6131efaef61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:05.247967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d914ac8e-d52b-482f-b8e6-6131efaef61d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:05.249201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d914ac8e-d52b-482f-b8e6-6131efaef61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:05.256879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:05.294832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96481-38dc-4775-bd51-272806b959d3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:05.306214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96481-38dc-4775-bd51-272806b959d3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:05.309762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98745f38-cb3d-4ad7-a995-6970ae638e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:05.310424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745f38-cb3d-4ad7-a995-6970ae638e9e service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:05.310708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745f38-cb3d-4ad7-a995-6970ae638e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:05.310988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98745f38-cb3d-4ad7-a995-6970ae638e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:05.319993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98745f38-cb3d-4ad7-a995-6970ae638e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:05.321412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98745f38-cb3d-4ad7-a995-6970ae638e9e service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:05.330735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 727/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:07.745142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850ff1-ae65-4910-8d2a-d6e947d4f030 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:07.745719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850ff1-ae65-4910-8d2a-d6e947d4f030 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:07.745719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850ff1-ae65-4910-8d2a-d6e947d4f030 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:07.747486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:07.753135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251286-0ab0-4319-a873-e915891e0ffb None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:07.753613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251286-0ab0-4319-a873-e915891e0ffb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:07.753788 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251286-0ab0-4319-a873-e915891e0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:07.772408 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-70251286-0ab0-4319-a873-e915891e0ffb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:07.773625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-70251286-0ab0-4319-a873-e915891e0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:07.782068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:07.819884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850ff1-ae65-4910-8d2a-d6e947d4f030 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:07.830733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850ff1-ae65-4910-8d2a-d6e947d4f030 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:07.834158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393be4-33c9-47da-aba8-57a13852d41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:07.834781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393be4-33c9-47da-aba8-57a13852d41b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:07.835058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393be4-33c9-47da-aba8-57a13852d41b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:07.835333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393be4-33c9-47da-aba8-57a13852d41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:07.844522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393be4-33c9-47da-aba8-57a13852d41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:07.845965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393be4-33c9-47da-aba8-57a13852d41b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:07.854993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 733/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:10.230507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50f3f0-c0c3-4e57-bc0c-2ebd3666e8f9 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:10.231033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50f3f0-c0c3-4e57-bc0c-2ebd3666e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:10.231165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50f3f0-c0c3-4e57-bc0c-2ebd3666e8f9 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:10.233455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:10.238827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec05ed6-4536-4f52-a1ae-a609ba4ad6eb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:10.239261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec05ed6-4536-4f52-a1ae-a609ba4ad6eb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:10.239385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec05ed6-4536-4f52-a1ae-a609ba4ad6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:10.257229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-9ec05ed6-4536-4f52-a1ae-a609ba4ad6eb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:10.258438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9ec05ed6-4536-4f52-a1ae-a609ba4ad6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:10.266564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:10.303920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50f3f0-c0c3-4e57-bc0c-2ebd3666e8f9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:10.314872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50f3f0-c0c3-4e57-bc0c-2ebd3666e8f9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:10.318388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e66d-eb5a-4109-a57f-d707d9f565bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:10.319265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e66d-eb5a-4109-a57f-d707d9f565bd service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:10.319541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e66d-eb5a-4109-a57f-d707d9f565bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:10.319810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e66d-eb5a-4109-a57f-d707d9f565bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:10.328368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53e66d-eb5a-4109-a57f-d707d9f565bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:10.329775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53e66d-eb5a-4109-a57f-d707d9f565bd service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:10.338782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 730/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:12.662581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ffdff-4cfb-4327-ab65-4d43f868d384 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:12.663144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ffdff-4cfb-4327-ab65-4d43f868d384 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:12.663144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ffdff-4cfb-4327-ab65-4d43f868d384 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:12.664903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:12.670108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ec4ff-0e1a-4f37-b200-a60a1064540f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:12.670554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ec4ff-0e1a-4f37-b200-a60a1064540f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:12.670649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ec4ff-0e1a-4f37-b200-a60a1064540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:12.688438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0d5ec4ff-0e1a-4f37-b200-a60a1064540f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:12.689617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0d5ec4ff-0e1a-4f37-b200-a60a1064540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:12.697461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:12.734596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ffdff-4cfb-4327-ab65-4d43f868d384 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:12.745301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ffdff-4cfb-4327-ab65-4d43f868d384 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:12.749752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b254-e958-4c8a-9359-3afdda664d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:12.750420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b254-e958-4c8a-9359-3afdda664d2b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:12.750701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b254-e958-4c8a-9359-3afdda664d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:12.750973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b254-e958-4c8a-9359-3afdda664d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:12.759598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b254-e958-4c8a-9359-3afdda664d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:12.761022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b254-e958-4c8a-9359-3afdda664d2b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:12.771273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 736/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:15.090671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47acb6e-1b1b-4878-8a6e-f5a591ec4d20 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:15.091231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47acb6e-1b1b-4878-8a6e-f5a591ec4d20 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:15.091231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47acb6e-1b1b-4878-8a6e-f5a591ec4d20 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:15.093206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:15.098525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2bb7-31eb-478d-bff3-c71f5aa2751f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:15.098971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2bb7-31eb-478d-bff3-c71f5aa2751f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:15.099066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2bb7-31eb-478d-bff3-c71f5aa2751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:15.116757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-02fb2bb7-31eb-478d-bff3-c71f5aa2751f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:15.117993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-02fb2bb7-31eb-478d-bff3-c71f5aa2751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:15.126360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:15.163502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47acb6e-1b1b-4878-8a6e-f5a591ec4d20 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:15.175137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47acb6e-1b1b-4878-8a6e-f5a591ec4d20 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:15.179032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8c34-3c1d-480d-a341-5e45a0f31bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:15.179656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8c34-3c1d-480d-a341-5e45a0f31bfa service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:15.179954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8c34-3c1d-480d-a341-5e45a0f31bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:15.180227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8c34-3c1d-480d-a341-5e45a0f31bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:15.189610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b8c34-3c1d-480d-a341-5e45a0f31bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:15.191053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b8c34-3c1d-480d-a341-5e45a0f31bfa service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:15.200391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 733/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:17.484360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b761cf-0293-4ce5-bd8e-4b24e8860ec0 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:17.484924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b761cf-0293-4ce5-bd8e-4b24e8860ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:17.484924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b761cf-0293-4ce5-bd8e-4b24e8860ec0 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:17.486710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 738/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:17.492042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e7ce-6337-4435-8a90-b7e78c70f7a4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:17.492491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e7ce-6337-4435-8a90-b7e78c70f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:17.492766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e7ce-6337-4435-8a90-b7e78c70f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:17.511219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7ef8e7ce-6337-4435-8a90-b7e78c70f7a4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:17.512397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7ef8e7ce-6337-4435-8a90-b7e78c70f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:17.520558 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 734/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:17.556717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b761cf-0293-4ce5-bd8e-4b24e8860ec0 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:17.567997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b761cf-0293-4ce5-bd8e-4b24e8860ec0 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:17.571730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7778d-57d2-4060-8afd-366c58dee2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:17.572358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7778d-57d2-4060-8afd-366c58dee2fc service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:17.572640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7778d-57d2-4060-8afd-366c58dee2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:17.572918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7778d-57d2-4060-8afd-366c58dee2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:17.581547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7778d-57d2-4060-8afd-366c58dee2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:17.583014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7778d-57d2-4060-8afd-366c58dee2fc service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:17.592112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 739/1473] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:38.292560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989cc40-a3ed-40ed-9555-25b90f4563cc None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:38.293160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989cc40-a3ed-40ed-9555-25b90f4563cc None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:38.293160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989cc40-a3ed-40ed-9555-25b90f4563cc None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:38.295568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 735/1474] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:38.300897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7122ea-fd6b-450d-bd17-b1876749e35f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:38.301319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7122ea-fd6b-450d-bd17-b1876749e35f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:38.301458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7122ea-fd6b-450d-bd17-b1876749e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:38.319344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ff7122ea-fd6b-450d-bd17-b1876749e35f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:38.320529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ff7122ea-fd6b-450d-bd17-b1876749e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:38.328248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 740/1475] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:38.374260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc43de-e07f-4b64-8a5c-cc0d064ccc6f None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:38.374551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc43de-e07f-4b64-8a5c-cc0d064ccc6f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:38.374834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc43de-e07f-4b64-8a5c-cc0d064ccc6f None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:38.376615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 736/1476] 10.222.0.30 () {54 vars in 961 bytes} [Tue Mar 8 14:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:38.381184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec853-74f0-42c0-9576-8c6764bee09f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:38.381474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec853-74f0-42c0-9576-8c6764bee09f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:38.381757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec853-74f0-42c0-9576-8c6764bee09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:38.399552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8a0ec853-74f0-42c0-9576-8c6764bee09f None None] MFA Rules not processed for user `8a7848c76d664adc9df92ab214c0c7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:38.400725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8a0ec853-74f0-42c0-9576-8c6764bee09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:38.407759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 741/1477] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Mar 8 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:38.414674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc43de-e07f-4b64-8a5c-cc0d064ccc6f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:38.425506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc43de-e07f-4b64-8a5c-cc0d064ccc6f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:38.428981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c08ab-e527-4b82-b317-24b26ce211c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:38.429602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c08ab-e527-4b82-b317-24b26ce211c8 service glance] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:38.429916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c08ab-e527-4b82-b317-24b26ce211c8 service glance] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:38.430196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c08ab-e527-4b82-b317-24b26ce211c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:38.439101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c08ab-e527-4b82-b317-24b26ce211c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:38.440605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c08ab-e527-4b82-b317-24b26ce211c8 service glance] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:38.450441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 737/1478] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:45:40.867391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22c66f-c632-46ad-a736-529d4d29d49f None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:40.867962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22c66f-c632-46ad-a736-529d4d29d49f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:40.867962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22c66f-c632-46ad-a736-529d4d29d49f None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:40.869835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 742/1479] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:40.875139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea8cb-b9cd-414a-bee3-2ba653ecabb6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:40.875546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea8cb-b9cd-414a-bee3-2ba653ecabb6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:40.875699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea8cb-b9cd-414a-bee3-2ba653ecabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:40.894165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-270ea8cb-b9cd-414a-bee3-2ba653ecabb6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:40.895356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-270ea8cb-b9cd-414a-bee3-2ba653ecabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:40.903416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 738/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:40.927524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22c66f-c632-46ad-a736-529d4d29d49f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:40.940021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22c66f-c632-46ad-a736-529d4d29d49f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:40.944723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce964-96bc-4b46-b49a-9a03fd5dce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:40.945377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce964-96bc-4b46-b49a-9a03fd5dce81 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:40.945659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce964-96bc-4b46-b49a-9a03fd5dce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:40.945969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce964-96bc-4b46-b49a-9a03fd5dce81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:40.946694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce964-96bc-4b46-b49a-9a03fd5dce81 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:40.948547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce964-96bc-4b46-b49a-9a03fd5dce81 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:40.962602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 743/1481] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Mar 8 14:45:40 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:45:43.285467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095108-775d-4db2-82fa-55d0cfddf87f None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:43.286035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095108-775d-4db2-82fa-55d0cfddf87f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:43.286159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d095108-775d-4db2-82fa-55d0cfddf87f None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:43.287816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 739/1482] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:43.293032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04caf-4e34-4c05-b9cd-0928750a4b73 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:43.293493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04caf-4e34-4c05-b9cd-0928750a4b73 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:43.293599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04caf-4e34-4c05-b9cd-0928750a4b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:43.312983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-48b04caf-4e34-4c05-b9cd-0928750a4b73 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:43.314218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-48b04caf-4e34-4c05-b9cd-0928750a4b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:43.322209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 744/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:43.363351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095108-775d-4db2-82fa-55d0cfddf87f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:43.378107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d095108-775d-4db2-82fa-55d0cfddf87f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:43.383351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccdf01-8e07-40d5-9bb3-f2414ed4190e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:43.384017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccdf01-8e07-40d5-9bb3-f2414ed4190e service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:43.384299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccdf01-8e07-40d5-9bb3-f2414ed4190e service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:43.384579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccdf01-8e07-40d5-9bb3-f2414ed4190e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:43.392566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccdf01-8e07-40d5-9bb3-f2414ed4190e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:43.394176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccdf01-8e07-40d5-9bb3-f2414ed4190e service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:43.403287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 740/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:45.893645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93caa-5192-4f85-aff7-2e4ff64b022c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:45.894188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93caa-5192-4f85-aff7-2e4ff64b022c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:45.894188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93caa-5192-4f85-aff7-2e4ff64b022c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:45.895900 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 745/1485] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:45.901270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c3e35-8a70-437d-b8c1-bfe5eaa34d7d None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:45.901705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c3e35-8a70-437d-b8c1-bfe5eaa34d7d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:45.901829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c3e35-8a70-437d-b8c1-bfe5eaa34d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:45.920654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-bb3c3e35-8a70-437d-b8c1-bfe5eaa34d7d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:45.921847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bb3c3e35-8a70-437d-b8c1-bfe5eaa34d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:45.929647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 741/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:45.965218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93caa-5192-4f85-aff7-2e4ff64b022c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:45.976268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93caa-5192-4f85-aff7-2e4ff64b022c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:45.979685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f045-4e09-4e7b-b5d1-4c5f810f7805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:45.980394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f045-4e09-4e7b-b5d1-4c5f810f7805 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:45.980746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f045-4e09-4e7b-b5d1-4c5f810f7805 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:45.981019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f045-4e09-4e7b-b5d1-4c5f810f7805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:45.990561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f045-4e09-4e7b-b5d1-4c5f810f7805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:45.991984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f045-4e09-4e7b-b5d1-4c5f810f7805 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:46.001069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 746/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:48.351081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286b25d-1183-4149-a232-622a9ee932c3 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:48.351656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286b25d-1183-4149-a232-622a9ee932c3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:48.351656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286b25d-1183-4149-a232-622a9ee932c3 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:48.353386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 742/1488] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:48.359262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3898f2-a83b-48a2-8c2a-1e30c3f31fb8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:48.359663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3898f2-a83b-48a2-8c2a-1e30c3f31fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:48.359814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3898f2-a83b-48a2-8c2a-1e30c3f31fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:48.378338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8f3898f2-a83b-48a2-8c2a-1e30c3f31fb8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:48.379526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8f3898f2-a83b-48a2-8c2a-1e30c3f31fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:48.387213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 747/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:48.425191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286b25d-1183-4149-a232-622a9ee932c3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:48.436374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286b25d-1183-4149-a232-622a9ee932c3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:48.440016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591f96-753b-4fa6-abca-18e63070556f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:48.440833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591f96-753b-4fa6-abca-18e63070556f service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:48.441256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591f96-753b-4fa6-abca-18e63070556f service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:48.441537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591f96-753b-4fa6-abca-18e63070556f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:48.452230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591f96-753b-4fa6-abca-18e63070556f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:48.453662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591f96-753b-4fa6-abca-18e63070556f service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:48.462905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 743/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:50.856349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7911b-b543-4bf8-b1b6-9f0a02b16bff None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:50.857439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7911b-b543-4bf8-b1b6-9f0a02b16bff None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:50.857600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7911b-b543-4bf8-b1b6-9f0a02b16bff None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:50.859304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 748/1491] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:45:50.864773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18976cb3-d1ad-457c-9843-8d212c86562e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:50.865215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18976cb3-d1ad-457c-9843-8d212c86562e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:50.865315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18976cb3-d1ad-457c-9843-8d212c86562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:50.883115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-18976cb3-d1ad-457c-9843-8d212c86562e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:50.884283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-18976cb3-d1ad-457c-9843-8d212c86562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:50.892264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 744/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:45:50.932811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7911b-b543-4bf8-b1b6-9f0a02b16bff None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:50.943914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7911b-b543-4bf8-b1b6-9f0a02b16bff None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:50.947473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d404215-5ebb-4c70-ade7-894744310812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:50.948216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d404215-5ebb-4c70-ade7-894744310812 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:50.948508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d404215-5ebb-4c70-ade7-894744310812 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:50.948781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d404215-5ebb-4c70-ade7-894744310812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:50.957665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d404215-5ebb-4c70-ade7-894744310812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:50.959129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d404215-5ebb-4c70-ade7-894744310812 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:50.969035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 749/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:45:53.484526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f36dc-7331-452f-997f-53c862ab5a7a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:53.485107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f36dc-7331-452f-997f-53c862ab5a7a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:53.485107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f36dc-7331-452f-997f-53c862ab5a7a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:53.486977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 745/1494] 10.222.0.30 () {54 vars in 926 bytes} [Tue Mar 8 14:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:45:53.492233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c0c5-0a4a-47ce-8d26-c1fa5b283e55 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:53.492667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c0c5-0a4a-47ce-8d26-c1fa5b283e55 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:53.492783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c0c5-0a4a-47ce-8d26-c1fa5b283e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:53.510882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0953c0c5-0a4a-47ce-8d26-c1fa5b283e55 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:45:53.512101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0953c0c5-0a4a-47ce-8d26-c1fa5b283e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:45:53.520789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 750/1495] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Mar 8 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:45:53.559743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f36dc-7331-452f-997f-53c862ab5a7a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:45:53.571347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f36dc-7331-452f-997f-53c862ab5a7a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:45:53.574820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c4d26-e3e5-4f7b-b608-191679d17a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:45:53.575446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c4d26-e3e5-4f7b-b608-191679d17a57 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:45:53.575793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c4d26-e3e5-4f7b-b608-191679d17a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:45:53.576149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c4d26-e3e5-4f7b-b608-191679d17a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:45:53.584879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c4d26-e3e5-4f7b-b608-191679d17a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:45:53.586334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c4d26-e3e5-4f7b-b608-191679d17a57 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:45:53.595496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 746/1496] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:47:21.173935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.174525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.174525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.192026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:47:21.193413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:47:21.201228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 751/1497] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:47:21.210258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f106-e225-4709-be9f-861257d9314a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.210768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f106-e225-4709-be9f-861257d9314a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.210870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f106-e225-4709-be9f-861257d9314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.228761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6b96f106-e225-4709-be9f-861257d9314a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:47:21.230639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6b96f106-e225-4709-be9f-861257d9314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:47:21.239627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 747/1498] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:47:21.244136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.254572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090b5b-6a79-459e-922e-a6c312694ac3 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.259170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.259820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.260096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.260368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.261203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:47:21.261588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.262610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.262610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:47:21.262610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:47:21.263486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.274783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 752/1499] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:47:21.282973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f106-e225-4709-be9f-861257d9314a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.291807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f106-e225-4709-be9f-861257d9314a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.297291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.297962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.298247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.298520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.299196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.300872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.300872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:47:21.300872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:47:21.302078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.336741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 748/1500] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:47:21 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:47:21.341439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.351058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b8ef0-128c-4ae8-8f38-a37c7d382c94 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.404939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.405599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.405900 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.406176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.406857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.407869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.407869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:47:21.407869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:47:21.409061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.429885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 753/1501] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:47:21 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:47:21.434695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.444983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78f69-eb44-4e20-81ec-05eeda5d005b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.450028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.450668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.450956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.451232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.451951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.452964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.452964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:47:21.452964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:47:21.453866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.467003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 749/1502] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:47:21.470883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.480368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543783-16e7-4768-9a88-9e4dfbf1d6d2 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.484879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.485524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.485803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.486110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.486817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.487824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.487824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:47:21.487824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:47:21.488691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715fd5d-baa5-4b54-b7b9-5e674d9c35f6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.501700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 754/1503] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:47:21.505646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.515896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b36a-c31b-4c74-8a92-5991db88617b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.520546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.521421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.521707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.522023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] PATH_INFO: `/v3/projects/50fa66873106410dbd3e63234bbae2bf/users/d4e8b79e85c94bc89688631261dc9657/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.536769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fa66873106410dbd3e63234bbae2bf, user_id=d4e8b79e85c94bc89688631261dc9657, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.537798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.537798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:47:21.537798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:47:21.539757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.552288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 750/1504] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:47:21 2022] PUT /identity/v3/projects/50fa66873106410dbd3e63234bbae2bf/users/d4e8b79e85c94bc89688631261dc9657/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:47:21.563500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a4e2-d318-4348-acad-e06f9d7b3024 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.563789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a4e2-d318-4348-acad-e06f9d7b3024 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.564063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a4e2-d318-4348-acad-e06f9d7b3024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.590188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c387a4e2-d318-4348-acad-e06f9d7b3024 None None] MFA Rules not processed for user `d4e8b79e85c94bc89688631261dc9657`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:47:21.591384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c387a4e2-d318-4348-acad-e06f9d7b3024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:47:21.651370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 755/1505] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:47:21.662797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.733919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2761d-c2fa-415c-bb47-23d519308808 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.739216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.739851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.740131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.740406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.747800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.749369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.757746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 751/1506] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:47:21.829053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c95d-6b4f-4212-96be-8305095ebf27 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.829339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c95d-6b4f-4212-96be-8305095ebf27 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.829614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c95d-6b4f-4212-96be-8305095ebf27 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.831334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 756/1507] 10.222.0.30 () {52 vars in 829 bytes} [Tue Mar 8 14:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:47:21.834929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:21.893569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e365b-dadc-41a0-8d5e-f0a048d62ef2 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:21.898023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:21.898882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:21.899161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:21.899433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] PATH_INFO: `/v3/users/d4e8b79e85c94bc89688631261dc9657` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:21.900585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e8b79e85c94bc89688631261dc9657)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:21.902181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:21.902181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:47:21.902181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:47:21.903604 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:21.968588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e8b79e85c94bc89688631261dc9657'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:21.977625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e8b79e85c94bc89688631261dc9657'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:21.998441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e8b79e85c94bc89688631261dc9657'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:21.999143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e8b79e85c94bc89688631261dc9657'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:21.999767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e8b79e85c94bc89688631261dc9657'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:22.016901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 752/1508] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:47:21 2022] DELETE /identity/v3/users/d4e8b79e85c94bc89688631261dc9657 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:47:22.021387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:22.021793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:22.022117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:22.039405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:47:22.040579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:47:22.096414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 757/1509] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:47:22.105803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:22.107222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:47:22.162436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd4d7b-e37d-464a-a0c2-139763318f72 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:22.165992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9320892-7677-462d-8bcf-b9ddeffa50da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:22.166671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320892-7677-462d-8bcf-b9ddeffa50da service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:22.166959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320892-7677-462d-8bcf-b9ddeffa50da service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:22.167375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320892-7677-462d-8bcf-b9ddeffa50da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:22.177035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9320892-7677-462d-8bcf-b9ddeffa50da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:22.178514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9320892-7677-462d-8bcf-b9ddeffa50da service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:22.187827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 753/1510] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:47:22.510528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:47:22.512754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:47:22.525198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bb87d-5a67-4dda-832f-2feca687aeeb None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:47:22.529910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:47:22.530725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:47:22.531000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:47:22.531267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] PATH_INFO: `/v3/projects/50fa66873106410dbd3e63234bbae2bf` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:47:22.532431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fa66873106410dbd3e63234bbae2bf)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:47:22.533464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:47:22.533464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:47:22.533464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:47:22.534700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:47:22.592454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fa66873106410dbd3e63234bbae2bf', 'request_id': 'req-daedfebb-26f2-4c18-bb11-ae52e0c306ee'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:22.601438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fa66873106410dbd3e63234bbae2bf', 'request_id': 'req-daedfebb-26f2-4c18-bb11-ae52e0c306ee'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:22.614638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fa66873106410dbd3e63234bbae2bf', 'request_id': 'req-daedfebb-26f2-4c18-bb11-ae52e0c306ee'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:22.625876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] The token cache is being invalidate because project 50fa66873106410dbd3e63234bbae2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:47:22.626176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:22.626815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-daedfebb-26f2-4c18-bb11-ae52e0c306ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:47:22.628447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 758/1511] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:47:22 2022] DELETE /identity/v3/projects/50fa66873106410dbd3e63234bbae2bf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:48:56.626585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576180-ad2d-45fb-b454-4191adf65190 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:56.627185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576180-ad2d-45fb-b454-4191adf65190 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:56.627185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576180-ad2d-45fb-b454-4191adf65190 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:56.629724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 754/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:48:56.635675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326fbb9-cca4-480d-8727-7a13088b7930 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:56.636136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326fbb9-cca4-480d-8727-7a13088b7930 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:56.636307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326fbb9-cca4-480d-8727-7a13088b7930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:56.656450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7326fbb9-cca4-480d-8727-7a13088b7930 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:48:56.657640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7326fbb9-cca4-480d-8727-7a13088b7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:48:56.715539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 759/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:48:56.874713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71576180-ad2d-45fb-b454-4191adf65190 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:48:56.877901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-71576180-ad2d-45fb-b454-4191adf65190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:48:56.911133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec430c0-a5d4-4a20-8a44-c2665bfb5ddf None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:56.911422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec430c0-a5d4-4a20-8a44-c2665bfb5ddf None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:56.911700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec430c0-a5d4-4a20-8a44-c2665bfb5ddf None None] PATH_INFO: `/v3` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:56.913155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 760/1514] 10.222.0.49 () {54 vars in 925 bytes} [Tue Mar 8 14:48:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:48:56.919778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d2890-88b3-401c-8904-f261e9a0b6ee None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:56.920060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d2890-88b3-401c-8904-f261e9a0b6ee None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:56.920332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d2890-88b3-401c-8904-f261e9a0b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:56.939014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-693d2890-88b3-401c-8904-f261e9a0b6ee None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:48:56.940214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-693d2890-88b3-401c-8904-f261e9a0b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:48:56.954449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71576180-ad2d-45fb-b454-4191adf65190 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:48:56.959752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acdb51-a482-4e45-bba1-0cfc2ab42383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:48:56.960399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acdb51-a482-4e45-bba1-0cfc2ab42383 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:56.960682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acdb51-a482-4e45-bba1-0cfc2ab42383 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:56.960959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acdb51-a482-4e45-bba1-0cfc2ab42383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:56.968942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acdb51-a482-4e45-bba1-0cfc2ab42383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:48:56.970786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acdb51-a482-4e45-bba1-0cfc2ab42383 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:48:56.979900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 755/1515] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:48:57.005395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 761/1516] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Mar 8 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:48:58.303497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f12dd-d49a-4e3d-856d-bf45827f520c None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:58.305949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f12dd-d49a-4e3d-856d-bf45827f520c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:58.305949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f12dd-d49a-4e3d-856d-bf45827f520c None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:58.306754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 756/1517] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:48:58.311640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54208b3-0936-4155-a79a-3f6adae2c646 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:58.312089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54208b3-0936-4155-a79a-3f6adae2c646 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:58.312227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54208b3-0936-4155-a79a-3f6adae2c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:58.330139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f54208b3-0936-4155-a79a-3f6adae2c646 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:48:58.331309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f54208b3-0936-4155-a79a-3f6adae2c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:48:58.339181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 762/1518] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:48:58.491417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f12dd-d49a-4e3d-856d-bf45827f520c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:48:58.505972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f12dd-d49a-4e3d-856d-bf45827f520c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:48:58.511619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce6c3-2214-48f8-b6e4-f5ce906a4962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:48:58.512250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce6c3-2214-48f8-b6e4-f5ce906a4962 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:48:58.512536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce6c3-2214-48f8-b6e4-f5ce906a4962 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:48:58.512815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce6c3-2214-48f8-b6e4-f5ce906a4962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:48:58.520745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce6c3-2214-48f8-b6e4-f5ce906a4962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:48:58.522365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce6c3-2214-48f8-b6e4-f5ce906a4962 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:48:58.532300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 757/1519] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:49:01.013219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30468ac-c558-4b7a-b2ff-5fe2c0d6fd30 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:01.013731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30468ac-c558-4b7a-b2ff-5fe2c0d6fd30 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:01.013873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30468ac-c558-4b7a-b2ff-5fe2c0d6fd30 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:01.015647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 763/1520] 10.222.0.30 () {54 vars in 960 bytes} [Tue Mar 8 14:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:01.020486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65431a2f-ae25-45e5-bb51-da139d4772e4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:01.020886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65431a2f-ae25-45e5-bb51-da139d4772e4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:01.021087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65431a2f-ae25-45e5-bb51-da139d4772e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:01.038647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-65431a2f-ae25-45e5-bb51-da139d4772e4 None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:01.040634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-65431a2f-ae25-45e5-bb51-da139d4772e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:01.048804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 758/1521] 10.222.0.30 () {58 vars in 1057 bytes} [Tue Mar 8 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:01.057442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30468ac-c558-4b7a-b2ff-5fe2c0d6fd30 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:01.070701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30468ac-c558-4b7a-b2ff-5fe2c0d6fd30 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:01.075809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44172858-a5f8-47f9-a9a3-5ed2a1c76440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:01.076433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172858-a5f8-47f9-a9a3-5ed2a1c76440 service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:01.076714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172858-a5f8-47f9-a9a3-5ed2a1c76440 service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:01.076985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44172858-a5f8-47f9-a9a3-5ed2a1c76440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:01.085313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172858-a5f8-47f9-a9a3-5ed2a1c76440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:01.086919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44172858-a5f8-47f9-a9a3-5ed2a1c76440 service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:01.096103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 764/1522] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:49:10.190432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdd43a-94a7-4dcb-8084-5283624f44c8 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:10.191012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdd43a-94a7-4dcb-8084-5283624f44c8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:10.191012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdd43a-94a7-4dcb-8084-5283624f44c8 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:10.192931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 759/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:10.198324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad9d4-f353-4505-b758-389e38724510 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:10.198782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad9d4-f353-4505-b758-389e38724510 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:10.198887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad9d4-f353-4505-b758-389e38724510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:10.216529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c3cad9d4-f353-4505-b758-389e38724510 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:10.217725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c3cad9d4-f353-4505-b758-389e38724510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:10.225610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 765/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:10.377228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdd43a-94a7-4dcb-8084-5283624f44c8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:10.391825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdd43a-94a7-4dcb-8084-5283624f44c8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:10.397287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b03d-a794-415d-a778-aebc83409ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:10.397938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b03d-a794-415d-a778-aebc83409ff3 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:10.398222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b03d-a794-415d-a778-aebc83409ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:10.398495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b03d-a794-415d-a778-aebc83409ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:10.407065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535b03d-a794-415d-a778-aebc83409ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:10.408639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535b03d-a794-415d-a778-aebc83409ff3 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:10.417713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 760/1525] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:49:11.678006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8ad5-8a3c-4bdf-845c-b53fc6c4e765 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:11.678554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8ad5-8a3c-4bdf-845c-b53fc6c4e765 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:11.678554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8ad5-8a3c-4bdf-845c-b53fc6c4e765 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:11.680873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 766/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 14:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:11.686131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c7cf-d7bf-42a9-a552-07bfaff76872 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:11.686538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c7cf-d7bf-42a9-a552-07bfaff76872 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:11.686684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c7cf-d7bf-42a9-a552-07bfaff76872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:11.704843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-dc51c7cf-d7bf-42a9-a552-07bfaff76872 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:11.706068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dc51c7cf-d7bf-42a9-a552-07bfaff76872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:11.713772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 761/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:11.867204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8ad5-8a3c-4bdf-845c-b53fc6c4e765 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:11.881673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8ad5-8a3c-4bdf-845c-b53fc6c4e765 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:11.887175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0bdec-30a6-442d-b881-40e53c97ba33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:11.887799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0bdec-30a6-442d-b881-40e53c97ba33 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:11.888077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0bdec-30a6-442d-b881-40e53c97ba33 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:11.888348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0bdec-30a6-442d-b881-40e53c97ba33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:11.896057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0bdec-30a6-442d-b881-40e53c97ba33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:11.897628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0bdec-30a6-442d-b881-40e53c97ba33 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:11.907128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 767/1528] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:49:16.183934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25297f5a-879c-4ee6-a2c0-905106f12fd8 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:16.184497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25297f5a-879c-4ee6-a2c0-905106f12fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:16.184497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25297f5a-879c-4ee6-a2c0-905106f12fd8 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:16.186349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 762/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:16.191988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78a1c-f655-48ba-9014-3b11318f82fc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:16.192439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78a1c-f655-48ba-9014-3b11318f82fc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:16.192554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb78a1c-f655-48ba-9014-3b11318f82fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:16.210895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2cb78a1c-f655-48ba-9014-3b11318f82fc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:16.212196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2cb78a1c-f655-48ba-9014-3b11318f82fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:16.219984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 768/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:16.256898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25297f5a-879c-4ee6-a2c0-905106f12fd8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:16.258672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-25297f5a-879c-4ee6-a2c0-905106f12fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:16.314412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25297f5a-879c-4ee6-a2c0-905106f12fd8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:16.318211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d2b4a-ddea-4e52-8fd0-60848092226c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:16.318861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2b4a-ddea-4e52-8fd0-60848092226c service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:16.319147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2b4a-ddea-4e52-8fd0-60848092226c service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:16.319428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2b4a-ddea-4e52-8fd0-60848092226c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:16.328310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d2b4a-ddea-4e52-8fd0-60848092226c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:16.329745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d2b4a-ddea-4e52-8fd0-60848092226c service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:16.339011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 763/1531] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:49:18.647635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb4c0-75f5-4eec-bd28-db78bb675e12 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:18.648220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb4c0-75f5-4eec-bd28-db78bb675e12 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:18.648220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb4c0-75f5-4eec-bd28-db78bb675e12 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:18.650559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 769/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:18.655720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21c4c-0f8f-418b-9c8c-5b8324b0beaf None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:18.656120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21c4c-0f8f-418b-9c8c-5b8324b0beaf None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:18.656270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21c4c-0f8f-418b-9c8c-5b8324b0beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:18.675174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-87e21c4c-0f8f-418b-9c8c-5b8324b0beaf None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:18.676383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-87e21c4c-0f8f-418b-9c8c-5b8324b0beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:18.684270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 764/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:18.721227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb4c0-75f5-4eec-bd28-db78bb675e12 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:18.732508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb4c0-75f5-4eec-bd28-db78bb675e12 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:18.736075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e347744-a15c-48e2-868c-676ff3e1ff39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:18.736738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e347744-a15c-48e2-868c-676ff3e1ff39 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:18.737021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e347744-a15c-48e2-868c-676ff3e1ff39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:18.737296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e347744-a15c-48e2-868c-676ff3e1ff39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:18.746047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e347744-a15c-48e2-868c-676ff3e1ff39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:18.747478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e347744-a15c-48e2-868c-676ff3e1ff39 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:18.756591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 770/1534] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:49:22.549080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5c7e-baef-4388-9dae-3d346d4f3b1a None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:22.549647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5c7e-baef-4388-9dae-3d346d4f3b1a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:22.549647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5c7e-baef-4388-9dae-3d346d4f3b1a None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:22.551474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 765/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:22.557365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edee6a-1102-430f-bbb8-1317163a757d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:22.557796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edee6a-1102-430f-bbb8-1317163a757d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:22.557990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edee6a-1102-430f-bbb8-1317163a757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:22.576490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c4edee6a-1102-430f-bbb8-1317163a757d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:22.577675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c4edee6a-1102-430f-bbb8-1317163a757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:22.585620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 771/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:22.842705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b5c7e-baef-4388-9dae-3d346d4f3b1a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:22.844356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0f4b5c7e-baef-4388-9dae-3d346d4f3b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:22.900648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b5c7e-baef-4388-9dae-3d346d4f3b1a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:22.904053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d931-5136-4236-93a8-f2ed412a5c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:22.904690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d931-5136-4236-93a8-f2ed412a5c23 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:22.904969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d931-5136-4236-93a8-f2ed412a5c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:22.905243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d931-5136-4236-93a8-f2ed412a5c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:22.913702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7d931-5136-4236-93a8-f2ed412a5c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:22.915838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7d931-5136-4236-93a8-f2ed412a5c23 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:22.925055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 766/1537] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:49:25.262821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095acaf6-50f5-466b-86c5-e30fa9e6315a None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:25.263393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095acaf6-50f5-466b-86c5-e30fa9e6315a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:25.263393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095acaf6-50f5-466b-86c5-e30fa9e6315a None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:25.265166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 772/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 14:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:25.270327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2ea5-41c3-4126-87b9-e2699596b168 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:25.270731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2ea5-41c3-4126-87b9-e2699596b168 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:25.270895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec2ea5-41c3-4126-87b9-e2699596b168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:25.289675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b1ec2ea5-41c3-4126-87b9-e2699596b168 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:25.291020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b1ec2ea5-41c3-4126-87b9-e2699596b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:25.298926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 767/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:25.557067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0ea5-81e9-4be9-87ef-c0ce6b63810e None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:25.557355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0ea5-81e9-4be9-87ef-c0ce6b63810e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:25.557633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0ea5-81e9-4be9-87ef-c0ce6b63810e None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:25.559431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 773/1540] 10.222.0.30 () {54 vars in 963 bytes} [Tue Mar 8 14:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:49:25.564349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814cfab-c8ae-4db0-89f8-08504110e4ce None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:25.564641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814cfab-c8ae-4db0-89f8-08504110e4ce None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:25.564923 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814cfab-c8ae-4db0-89f8-08504110e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:25.584583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0814cfab-c8ae-4db0-89f8-08504110e4ce None None] MFA Rules not processed for user `faa371f194b149bd86f53b5de40bb719`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:49:25.586282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0814cfab-c8ae-4db0-89f8-08504110e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:49:25.592702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 768/1541] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Mar 8 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:49:25.599933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0ea5-81e9-4be9-87ef-c0ce6b63810e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:49:25.610971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0ea5-81e9-4be9-87ef-c0ce6b63810e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:49:25.614419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607905ce-6457-4fdc-8842-f84ee0d3208e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:49:25.615038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607905ce-6457-4fdc-8842-f84ee0d3208e service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:49:25.615344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607905ce-6457-4fdc-8842-f84ee0d3208e service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:49:25.615620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607905ce-6457-4fdc-8842-f84ee0d3208e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:49:25.624382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607905ce-6457-4fdc-8842-f84ee0d3208e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:49:25.625805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607905ce-6457-4fdc-8842-f84ee0d3208e service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:49:25.634917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 774/1542] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:50:56.688515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:56.689178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:56.689178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:56.719278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:56.720892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:56.731985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 769/1543] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:56.741599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:56.742210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:56.742210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:56.770070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:56.771638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:56.789967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 775/1544] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:56.795982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:56.811078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b03c44-3386-422b-b081-734e7acf78ba None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:56.819004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:56.820104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:56.820645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:56.821163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:56.822264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:56.822827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:56.824089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:50:56.824089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:50:56.824089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:50:56.825476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3002db-5718-4196-b1cc-edf5fd6ea124 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:56.844696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 770/1545] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:56.854838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:56.869442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6eee7-fc9b-48c3-a4e4-3e0cd80cb2e8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:56.877267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:56.877993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:56.878282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:56.878561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:56.879267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:56.880465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:50:56.880465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:50:56.880465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:50:56.881723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:56.926871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 776/1546] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:56 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:56.930671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49134-e0f0-4d65-8ecc-96bb84acaca5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:56.931862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:56.934430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49134-e0f0-4d65-8ecc-96bb84acaca5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:56.934792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49134-e0f0-4d65-8ecc-96bb84acaca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:56.963584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-74c49134-e0f0-4d65-8ecc-96bb84acaca5 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:56.964926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-74c49134-e0f0-4d65-8ecc-96bb84acaca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.062613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403006-6398-4b8c-b972-5041f1ae8e80 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.073560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5bbb-a6e4-4b5d-8416-da0a502c1ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.074579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5bbb-a6e4-4b5d-8416-da0a502c1ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.074710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5bbb-a6e4-4b5d-8416-da0a502c1ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.074922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5bbb-a6e4-4b5d-8416-da0a502c1ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.076151 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee5bbb-a6e4-4b5d-8416-da0a502c1ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.078303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee5bbb-a6e4-4b5d-8416-da0a502c1ff3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.081810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 771/1547] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.085985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebbb62-8424-416a-b9ac-7d02f0f8445a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.086278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebbb62-8424-416a-b9ac-7d02f0f8445a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.086561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebbb62-8424-416a-b9ac-7d02f0f8445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.117042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b5ebbb62-8424-416a-b9ac-7d02f0f8445a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.118716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b5ebbb62-8424-416a-b9ac-7d02f0f8445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.126867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 777/1548] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:56 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.130328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b08b-4769-4d95-ae0c-d76d3fb518b4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.130851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b08b-4769-4d95-ae0c-d76d3fb518b4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.131230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b08b-4769-4d95-ae0c-d76d3fb518b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.135872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 772/1549] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.137211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ba4e-299f-4589-b73d-63b66293d920 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.137503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ba4e-299f-4589-b73d-63b66293d920 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.137780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ba4e-299f-4589-b73d-63b66293d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.157097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b2d2b08b-4769-4d95-ae0c-d76d3fb518b4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.158326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1166ba4e-299f-4589-b73d-63b66293d920 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.158470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b2d2b08b-4769-4d95-ae0c-d76d3fb518b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.159778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1166ba4e-299f-4589-b73d-63b66293d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.167138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 778/1550] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.168457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 773/1551] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.168585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.168693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.168919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.173135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c7a1-21c8-42db-bd42-cc353d446561 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.173435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c7a1-21c8-42db-bd42-cc353d446561 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.173722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c7a1-21c8-42db-bd42-cc353d446561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.188383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.189908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.192954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6859c7a1-21c8-42db-bd42-cc353d446561 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.194227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6859c7a1-21c8-42db-bd42-cc353d446561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.198831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 779/1552] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.199823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.207143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 774/1553] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.208711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf05fa-3f48-41b0-ac8c-ebd3cd083294 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.208986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf05fa-3f48-41b0-ac8c-ebd3cd083294 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.209267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf05fa-3f48-41b0-ac8c-ebd3cd083294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.218368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13606be-9064-457a-9a11-7ba5bc9ec315 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.223378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.224196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.224626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.224902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.225798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.227218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-19cf05fa-3f48-41b0-ac8c-ebd3cd083294 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.227477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.228405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-19cf05fa-3f48-41b0-ac8c-ebd3cd083294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.236184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 775/1554] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.237395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3db1e2-0f88-4633-a848-173434839bbe None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.237686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3db1e2-0f88-4633-a848-173434839bbe None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.238005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3db1e2-0f88-4633-a848-173434839bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.238235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 780/1555] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:57.239594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.249406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301890e-4055-4ae4-b262-5f0dbc220788 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.253753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.254597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.255380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.255654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.256363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.256664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.258288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42651-f8e0-42d3-833e-65e5d1d7c7ed admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.260481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6a3db1e2-0f88-4633-a848-173434839bbe None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.261668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6a3db1e2-0f88-4633-a848-173434839bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.269518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 776/1556] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.270796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afc491-a21f-4bc4-a170-06ca1559956b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.271226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 781/1557] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.272793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b96b2-9f2f-4f20-ba8a-25504946bc7e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.273081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b96b2-9f2f-4f20-ba8a-25504946bc7e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.273710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b96b2-9f2f-4f20-ba8a-25504946bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.278117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afc491-a21f-4bc4-a170-06ca1559956b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.278440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afc491-a21f-4bc4-a170-06ca1559956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.292217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-395b96b2-9f2f-4f20-ba8a-25504946bc7e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.293434 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-395b96b2-9f2f-4f20-ba8a-25504946bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.296962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-83afc491-a21f-4bc4-a170-06ca1559956b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.298139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-83afc491-a21f-4bc4-a170-06ca1559956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.301653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 782/1558] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.302934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.303220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.303497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.306951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 777/1559] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.311717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48df05-1ea0-4a34-a759-28a25300a2a9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.312006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48df05-1ea0-4a34-a759-28a25300a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.312290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48df05-1ea0-4a34-a759-28a25300a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.322543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.323713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.329654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1e48df05-1ea0-4a34-a759-28a25300a2a9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.330818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1e48df05-1ea0-4a34-a759-28a25300a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.331388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 783/1560] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.332139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.338858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 778/1561] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.340137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.340424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.340699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.341404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd624e1-ae61-4486-80d7-f7fa61c1072a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.345966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.346622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.346903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.347177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.347951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.350100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.358335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.359504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.359941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 784/1562] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:57.360729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.368167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 779/1563] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.368986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.370753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae42f5-0092-4b08-bafb-d98d3fa6f9d8 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.375532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.376184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.376467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.376740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.377446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.377751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.378401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d362-c89a-4fc6-9dab-0b265920ce7e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.379426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.383200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.383833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.384113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.384388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.385063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.387081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.391110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 785/1564] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.394049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.404120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fde02-6c4c-4aa5-8e28-4f2e9fb706a9 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.409482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.410160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.410447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.411239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.411943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.412249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.416165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 780/1565] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.416165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.416389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.426214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 786/1566] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.429340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.443337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c12c-f31b-4920-8d9d-17f5909396ab admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.477660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f9a8-2923-49f7-b020-87a960397860 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.486392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.487055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.489437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.489713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.490458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.490768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.492476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163277d4-b382-4caf-8dcf-7282737cd795 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.496408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.497095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.497372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.497645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.498379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.498685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.500275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.503907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 781/1567] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.505984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.506271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.506547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.513002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 787/1568] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.513833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.523950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1522c-0a57-4706-8f12-3b078bd39ad6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.525575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.526828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.528539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.529440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.529720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.530024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] PATH_INFO: `/v3/projects/e46d176642e64537baf1e1b72fc1632c/users/39a64f307d82492eaa1d34ce6f0925de/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.534473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 782/1569] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.535231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.544333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc38409-12f1-4f03-bb9e-acbca1d3aaa0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.547760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46d176642e64537baf1e1b72fc1632c, user_id=39a64f307d82492eaa1d34ce6f0925de, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.548794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.548956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:50:57.548956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:50:57.548956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:50:57.549428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.549705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.550009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.550706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.550808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.551009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.552730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.565349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 783/1570] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.566448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.566843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 788/1571] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:57 2022] PUT /identity/v3/projects/e46d176642e64537baf1e1b72fc1632c/users/39a64f307d82492eaa1d34ce6f0925de/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:57.570673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.582479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48eef-d3f4-4aba-83af-f7d8afdde8f7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.635959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741aad1-eb9c-4586-8569-cda55ea5ffb5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.638674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.639371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.639628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.639904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.640589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.640765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.641419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.641693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.641995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.642546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.642722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.644588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.665560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 789/1572] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.666531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.672734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 784/1573] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.672734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.676073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14856368-2964-4883-a2e4-362711a7ae69 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.730602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.730979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1480-e50a-4593-9a6c-98e8c886f7bc admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.731485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.731578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.731783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.732463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.734401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.735608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.736258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.736541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.736820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.737505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.739964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.764197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 790/1574] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.764197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.764862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 785/1575] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.765220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.825665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2755a3-1a62-42fd-b2cb-bdd5a0223ef0 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.830136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c9b2-8642-41aa-ab96-c865f14f520e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.830309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed16b9-de61-4f5b-b12a-cf6ed6ea43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.830996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed16b9-de61-4f5b-b12a-cf6ed6ea43a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.831286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed16b9-de61-4f5b-b12a-cf6ed6ea43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.831540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed16b9-de61-4f5b-b12a-cf6ed6ea43a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.832223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed16b9-de61-4f5b-b12a-cf6ed6ea43a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.834779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed16b9-de61-4f5b-b12a-cf6ed6ea43a9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.837083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.837747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.838074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.838354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.839072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:50:57.839649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.840951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.853116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 786/1576] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:50:57.853995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.863328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d67c-e883-4acd-91a5-fd072c5f161d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.868719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.869359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.869642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.869967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.870350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 791/1577] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.870704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.871474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.871764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.872040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.872675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.898769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 787/1578] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:57.900470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] MFA Rules not processed for user `39a64f307d82492eaa1d34ce6f0925de`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:57.901683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:57.902811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.966514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 792/1579] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:57.967411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.968069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7170f-fde9-4079-9b84-9f0bb28502d3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.973032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.974298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.974586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.974976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.975709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.977398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.979486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97a390-eac6-4b2d-970c-0f1f0f3fb57a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:57.984422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:57.985021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:57.985306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:57.985606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:57.986316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:57.991081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 788/1580] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:57.991081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:57.991338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:57.999343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6daaa6-9fb4-4198-a1ee-f4ab3481faf1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.004289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.005477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.005764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.006078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.006756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.007769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:50:58.007769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:50:58.007769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:50:58.008961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.011701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 793/1581] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.015598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.026864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d2c57-8ba2-4c64-a58c-e18e05737775 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.029890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 789/1582] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:57 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.029890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.034398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.035056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.035338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.035616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.037005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.038655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31800-cbdf-4230-85f2-c68fe1ea0b0b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.038984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.043122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.043746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.044034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.044314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.044979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.046906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.062222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 794/1583] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/users => generated 284 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.062222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.070547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5ea8-f013-41e7-8035-9f2fb59245c9 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.075087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3a78-a226-4d07-9a72-118e0a2f0f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.075737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3a78-a226-4d07-9a72-118e0a2f0f77 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.076013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3a78-a226-4d07-9a72-118e0a2f0f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.076295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3a78-a226-4d07-9a72-118e0a2f0f77 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.076967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb3a78-a226-4d07-9a72-118e0a2f0f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.078035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 790/1584] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.078920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.079033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb3a78-a226-4d07-9a72-118e0a2f0f77 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.099729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 795/1585] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.101033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17369cd-40c6-43e0-973d-bf8259b8d230 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.101316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17369cd-40c6-43e0-973d-bf8259b8d230 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.101593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17369cd-40c6-43e0-973d-bf8259b8d230 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.103586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 796/1586] 10.222.0.30 () {54 vars in 961 bytes} [Tue Mar 8 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:50:58.104309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17369cd-40c6-43e0-973d-bf8259b8d230 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.151247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b544f-b4fe-4b36-a115-eb77e6d389bf admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.156248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.156926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.157213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.157489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.158226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.160142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.174174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17369cd-40c6-43e0-973d-bf8259b8d230 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.178918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.179689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.179975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.180244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.180956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.182673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.185393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 791/1587] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.186318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.193986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 797/1588] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.194705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.199833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec4fd3-a54b-476d-8d54-1c9f7319bf55 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.204651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.205149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553842a-0a21-4f74-a508-03e934e454b9 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.205314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.205601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.205901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.206685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.209145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.210399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.211042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.211318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.211589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.212322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.213923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.219507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 792/1589] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.220120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.225998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 798/1590] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.225998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.232020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413ad80-467f-4e7b-b38a-70502355f0c2 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.235605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc26e8-4a25-4b73-a248-748eddcf95e7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.236620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.237276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.237560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.237838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.238584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.240159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f383b43-040f-4bf7-a99b-a18fb8b0cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.240500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.240846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383b43-040f-4bf7-a99b-a18fb8b0cb72 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.241129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383b43-040f-4bf7-a99b-a18fb8b0cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.241397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383b43-040f-4bf7-a99b-a18fb8b0cb72 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.242104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383b43-040f-4bf7-a99b-a18fb8b0cb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.243995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383b43-040f-4bf7-a99b-a18fb8b0cb72 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.250663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 793/1591] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.251451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.261436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31ed5-a5fb-426b-b2c5-9e8aca3ea03b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.264174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 799/1592] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:58.265415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.265700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.266047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.268878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.269606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.269938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.270381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.271080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.272669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.286969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 794/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.287173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:58.287273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.287368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:58.294711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1569b4-a99b-419a-9b66-168d5db87f97 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.299321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.299964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.300247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.300527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.301232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.302935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.312486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 795/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.313335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.325583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514e1aa-9478-4fb2-903c-8e8a2a86d2ee admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.330244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.331381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.331676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.331963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] PATH_INFO: `/v3/projects/7ac3fd6058904fbabe43c68e8d7c7654/users/00aa26c0dc804f949002193e1919183d/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.346855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac3fd6058904fbabe43c68e8d7c7654, user_id=00aa26c0dc804f949002193e1919183d, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.349687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.350987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 800/1595] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:58.351617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.362427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f62d7-87b0-4c81-99b3-78201e595c41 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.364214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 796/1596] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/7ac3fd6058904fbabe43c68e8d7c7654/users/00aa26c0dc804f949002193e1919183d/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:58.365187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.419134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.419807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.420093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.420374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.421093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.422741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.425222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0666002-46e6-4f60-99c6-956b10e693de admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.430562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.431249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.431531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.431813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.432522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.432875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 801/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.433674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.437323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.443540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c888b7-2be1-48fb-b228-f614b052f49e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.448366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.451817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 797/1598] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.451963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.451963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.451963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.452218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.452312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.452312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.461693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1786-c721-4c2e-94a5-70726d0546ab admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.462916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 802/1599] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.463605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.466512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.467177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.467520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.467806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.468542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.470154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.473201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997902-b412-40b4-adbf-25e9604dfdc0 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.477966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.478601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.478884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.479153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.479853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.483151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 798/1600] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.483151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.483400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.492822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db32aa-5ec3-448c-87ef-8d4fe0c948ad admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.493315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 803/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.494154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.497984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bc99d-3a2e-4000-9bf8-4effa8cf1b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.498678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc99d-3a2e-4000-9bf8-4effa8cf1b06 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.498962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc99d-3a2e-4000-9bf8-4effa8cf1b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.499239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc99d-3a2e-4000-9bf8-4effa8cf1b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.499964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bc99d-3a2e-4000-9bf8-4effa8cf1b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.501817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bc99d-3a2e-4000-9bf8-4effa8cf1b06 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.513140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 799/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.514539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.514822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.515095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.532318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:58.533502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:58.540990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 800/1603] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:58.541737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.550692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b8b9b-a6e0-4d4c-b035-3698c83420ef None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.555874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.556746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.557023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.557292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] PATH_INFO: `/v3/projects/c2e68f7ac86d45539e8fa393fee88cb5/users/53133ebe47414bb392ffeaca71a1f342/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.568658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acfb4c-b1ee-43aa-a7f2-c0b91bc0b580 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.572445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e68f7ac86d45539e8fa393fee88cb5, user_id=53133ebe47414bb392ffeaca71a1f342, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.574168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.574811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.575093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.575200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.575372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.588532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 801/1604] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/c2e68f7ac86d45539e8fa393fee88cb5/users/53133ebe47414bb392ffeaca71a1f342/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:58.592274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.630040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.631646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.640176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 804/1605] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:58.640929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.649096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc120-5139-44e6-88ee-fdddd3eff638 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.650940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc82497-831c-44db-a129-3dbdaf38cb74 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.653791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.654749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.655039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.655320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] PATH_INFO: `/v3/projects/3f98f6f0a9d945e88b01a9da19044aa1/users/51ed61d0a16d465889c0474a4d2b7dee/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.655537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.656400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.656678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.656950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] PATH_INFO: `/v3/projects/d21b9d56eff240819bd69978a7a10992/users/ee12a6f5fb244832a4701a63861e5fa5/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.670895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f98f6f0a9d945e88b01a9da19044aa1, user_id=51ed61d0a16d465889c0474a4d2b7dee, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.671229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21b9d56eff240819bd69978a7a10992, user_id=ee12a6f5fb244832a4701a63861e5fa5, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.673533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.673877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.697967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 805/1606] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/d21b9d56eff240819bd69978a7a10992/users/ee12a6f5fb244832a4701a63861e5fa5/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:58.698196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 802/1607] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/3f98f6f0a9d945e88b01a9da19044aa1/users/51ed61d0a16d465889c0474a4d2b7dee/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:58.698196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.698403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.766975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1cc6f-6ea0-4c85-a8d3-9f21c981b301 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.767546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cfa31-7d8f-4590-b772-bbbe6f7fdeff admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.772142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.772642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.773032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.773305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.773412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.773568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] PATH_INFO: `/v3/projects/0cdd8e70c5dc4d1a8f531591dbd9216f/users/1775260bd3f947ea85d14b3a1aa80b38/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.773680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.773869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.774593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.777154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.787042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 806/1608] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:58.787701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.792317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdd8e70c5dc4d1a8f531591dbd9216f, user_id=1775260bd3f947ea85d14b3a1aa80b38, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.795325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.796717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff0ac-f9d7-424d-82c8-6224ac299491 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.802240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc989d-ee0e-4a44-9f5c-fcbc77ba5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.802812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc989d-ee0e-4a44-9f5c-fcbc77ba5afd admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.803261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc989d-ee0e-4a44-9f5c-fcbc77ba5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.803542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc989d-ee0e-4a44-9f5c-fcbc77ba5afd admin admin] PATH_INFO: `/v3/projects/46dce7630acc4cbc80b4cb3ba27c7dd9/users/3a343c19dc5f4ca1bcf659d05ffa92c7/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.811717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 803/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/0cdd8e70c5dc4d1a8f531591dbd9216f/users/1775260bd3f947ea85d14b3a1aa80b38/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:58.812736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.814663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:58.823601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc989d-ee0e-4a44-9f5c-fcbc77ba5afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dce7630acc4cbc80b4cb3ba27c7dd9, user_id=3a343c19dc5f4ca1bcf659d05ffa92c7, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.826441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc989d-ee0e-4a44-9f5c-fcbc77ba5afd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.841172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 807/1610] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/46dce7630acc4cbc80b4cb3ba27c7dd9/users/3a343c19dc5f4ca1bcf659d05ffa92c7/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:58.842497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8849f-3e68-4186-ab5b-f54da668b0e1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.842789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8849f-3e68-4186-ab5b-f54da668b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.843059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8849f-3e68-4186-ab5b-f54da668b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.862051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-20e8849f-3e68-4186-ab5b-f54da668b0e1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:58.863287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-20e8849f-3e68-4186-ab5b-f54da668b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:58.883752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9951-44a4-45eb-85fe-637a0e48abe4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:58.928164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 808/1611] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:58.928713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.929058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.929341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.936743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6e298-95a6-4790-9ce4-905ed4fc4e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:58.937520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e298-95a6-4790-9ce4-905ed4fc4e0e service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.937879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e298-95a6-4790-9ce4-905ed4fc4e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.938241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6e298-95a6-4790-9ce4-905ed4fc4e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.949505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6e298-95a6-4790-9ce4-905ed4fc4e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:58.951030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6e298-95a6-4790-9ce4-905ed4fc4e0e service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:58.956037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:58.957428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:58.961495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 804/1612] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:58.962779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6971b4-5d14-49c1-baab-1d36b1ea3be3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:58.963059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6971b4-5d14-49c1-baab-1d36b1ea3be3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:58.963457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6971b4-5d14-49c1-baab-1d36b1ea3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:58.975839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 809/1613] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:58.975839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:58.993879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-5b6971b4-5d14-49c1-baab-1d36b1ea3be3 None None] MFA Rules not processed for user `ee12a6f5fb244832a4701a63861e5fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:58.994851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5b6971b4-5d14-49c1-baab-1d36b1ea3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:59.001722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334ddd-3a89-4c2e-9201-efbde9dd32e1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.010432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c734f-98d0-4c05-ae1a-aae608e5b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.011550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c734f-98d0-4c05-ae1a-aae608e5b6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.011901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c734f-98d0-4c05-ae1a-aae608e5b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.012423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c734f-98d0-4c05-ae1a-aae608e5b6e6 admin admin] PATH_INFO: `/v3/projects/29ec0be7f0e14c159f69c6f88937306f/users/66ec6695b3034373864880f974042903/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.035623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c734f-98d0-4c05-ae1a-aae608e5b6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ec0be7f0e14c159f69c6f88937306f, user_id=66ec6695b3034373864880f974042903, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.039264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c734f-98d0-4c05-ae1a-aae608e5b6e6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.058652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 810/1614] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:58 2022] PUT /identity/v3/projects/29ec0be7f0e14c159f69c6f88937306f/users/66ec6695b3034373864880f974042903/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:59.060598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.061094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.061441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.071152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 805/1615] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:59.073010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.073515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.074128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.087828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:59.089256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:59.100834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:59.102185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:59.168538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 811/1616] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:59.169708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.199171 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 806/1617] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:59.200153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.256822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee50b0-a7ca-4879-8ed9-c64a2dbd4a84 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.260597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269cce-2927-400e-81c2-729725bae8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.261252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269cce-2927-400e-81c2-729725bae8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.261533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269cce-2927-400e-81c2-729725bae8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.261807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269cce-2927-400e-81c2-729725bae8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.266192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60613a0b-2b0f-4093-9cf6-a7a0816483e8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.270090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.270951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.271480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.271961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.272075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269cce-2927-400e-81c2-729725bae8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.273423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269cce-2927-400e-81c2-729725bae8a5 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.282937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 812/1618] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:59.284268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252fde1-31f0-4da7-9c32-5cee324423e7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.284557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252fde1-31f0-4da7-9c32-5cee324423e7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.284834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252fde1-31f0-4da7-9c32-5cee324423e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.285122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.287297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.300621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 807/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:59.302259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.316376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6252fde1-31f0-4da7-9c32-5cee324423e7 None None] MFA Rules not processed for user `66ec6695b3034373864880f974042903`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:59.319041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6252fde1-31f0-4da7-9c32-5cee324423e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:59.398765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e262-d714-443c-943b-66955b6f995e service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.413078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 813/1620] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:59.413251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665664-0eb5-4f2c-ab03-b52900ed5efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.413251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665664-0eb5-4f2c-ab03-b52900ed5efc service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.415019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d204e5-3326-4d15-8777-419146351b1b None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.415127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665664-0eb5-4f2c-ab03-b52900ed5efc service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.415127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665664-0eb5-4f2c-ab03-b52900ed5efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.415287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d204e5-3326-4d15-8777-419146351b1b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.415287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d204e5-3326-4d15-8777-419146351b1b None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.416792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 814/1621] 10.222.0.30 () {54 vars in 961 bytes} [Tue Mar 8 14:50:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:50:59.418015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d204e5-3326-4d15-8777-419146351b1b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.432556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d204e5-3326-4d15-8777-419146351b1b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.436416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.437205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.437500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.437784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.448848 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.450841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.464835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 815/1622] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:59.465690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.478369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f7118-1f1b-444b-a345-2bc7aeb8c8fa service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.486169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.487087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.487383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.487748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.502415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.504711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.522099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 816/1623] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:59.523393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.527378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b665664-0eb5-4f2c-ab03-b52900ed5efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.529134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b665664-0eb5-4f2c-ab03-b52900ed5efc service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.534070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b13fd-651e-495f-b65c-54ef4c7c4bb8 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.541525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 808/1624] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:50:59.543027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4b621-4aac-45b0-93f9-7dfdf736530a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.543446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4b621-4aac-45b0-93f9-7dfdf736530a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.543731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4b621-4aac-45b0-93f9-7dfdf736530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.553538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.554328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.554589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.554894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.555602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.559272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.573567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-07e4b621-4aac-45b0-93f9-7dfdf736530a None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:59.579470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-07e4b621-4aac-45b0-93f9-7dfdf736530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:59.609917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 817/1625] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:59.617599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.720219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef1c0-f3f8-48ac-9544-7496c0fe912f admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.727622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.728418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.728708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.728988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.729844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.732952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.740668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 809/1626] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:50:59.747101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979a4c8-cf3d-4e9e-8617-0b2a5a93a08b None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.747271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979a4c8-cf3d-4e9e-8617-0b2a5a93a08b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.747560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979a4c8-cf3d-4e9e-8617-0b2a5a93a08b None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.749276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 810/1627] 10.222.0.30 () {54 vars in 912 bytes} [Tue Mar 8 14:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:50:59.756096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.756581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.757135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.773464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 818/1628] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:50:59.775402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.791325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:50:59.792502 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02bdd1-784b-4453-a8d8-0c300b228b8b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.792641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:50:59.800577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.801266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.802141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.802389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.803123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.806231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.839675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 819/1629] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:50:59.843698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.869803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a508-e77f-497a-9cc4-14fe3d485afd admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:50:59.881741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 811/1630] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:50:59.898109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:50:59.911389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:50:59.913141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:50:59.914034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:50:59.914323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] PATH_INFO: `/v3/projects/f2167e65dfc0489694e238937b7cd8bf/users/fcf74d4064ee482ab150a170f359c845/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:50:59.960096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2167e65dfc0489694e238937b7cd8bf, user_id=fcf74d4064ee482ab150a170f359c845, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:50:59.965203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:50:59.992537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 820/1631] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:50:59 2022] PUT /identity/v3/projects/f2167e65dfc0489694e238937b7cd8bf/users/fcf74d4064ee482ab150a170f359c845/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:50:59.993663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:00.003747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f198d-7901-4ea4-a4a6-85bee2673622 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.090491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21cb7d-7743-42c0-ac8d-63d0f6b832e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.091437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21cb7d-7743-42c0-ac8d-63d0f6b832e2 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.091730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21cb7d-7743-42c0-ac8d-63d0f6b832e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.092010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21cb7d-7743-42c0-ac8d-63d0f6b832e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.106353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5536-59e1-40ae-a4a1-c2604febb062 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.123179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.123880 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.125782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.126101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.127968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.134096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.168678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 821/1632] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:00.172917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:00.187083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26684a7a-d09f-4ea2-8ceb-1ac84fa057cf admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.189513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21cb7d-7743-42c0-ac8d-63d0f6b832e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.191344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21cb7d-7743-42c0-ac8d-63d0f6b832e2 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.193484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517a98d-6253-4cf8-b613-13c1d38ee16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.194790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a98d-6253-4cf8-b613-13c1d38ee16f admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.195227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a98d-6253-4cf8-b613-13c1d38ee16f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.195604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517a98d-6253-4cf8-b613-13c1d38ee16f admin admin] PATH_INFO: `/v3/projects/f2167e65dfc0489694e238937b7cd8bf/users/fcf74d4064ee482ab150a170f359c845/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.199028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a98d-6253-4cf8-b613-13c1d38ee16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2167e65dfc0489694e238937b7cd8bf, user_id=fcf74d4064ee482ab150a170f359c845, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.203493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517a98d-6253-4cf8-b613-13c1d38ee16f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.210550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 812/1633] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:00.228952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.229109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 822/1634] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:00 2022] PUT /identity/v3/projects/f2167e65dfc0489694e238937b7cd8bf/users/fcf74d4064ee482ab150a170f359c845/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:00.229774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.230351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.273758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] MFA Rules not processed for user `fcf74d4064ee482ab150a170f359c845`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:00.275100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:00.403916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829024d-3078-46d5-a451-b6dbf4875056 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.404324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829024d-3078-46d5-a451-b6dbf4875056 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.404801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829024d-3078-46d5-a451-b6dbf4875056 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.406955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 823/1635] 10.222.0.30 () {54 vars in 912 bytes} [Tue Mar 8 14:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:51:00.413003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.413293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.413658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.414035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 813/1636] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:00.429623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:00.438664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:00.440983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:00.496697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a898-77a9-43a9-b051-30df1641ca5f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.501254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.501932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.502367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.502755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.522092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.523747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.539871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 814/1637] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:00.543987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 824/1638] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:00.558537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:00.571053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abc382-7dca-45d1-8b16-6a45be598923 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.575697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.576399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.576727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.576999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.591434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.593044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.608618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 815/1639] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:00.619836 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:00.633333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596054b-bdfb-4c9d-b49e-f06a8969a5a0 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.638723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b5728-42f9-414c-ab28-e30ba90a842f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.639621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5728-42f9-414c-ab28-e30ba90a842f service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.640121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5728-42f9-414c-ab28-e30ba90a842f service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.640575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5728-42f9-414c-ab28-e30ba90a842f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.705082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:00.720937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b5728-42f9-414c-ab28-e30ba90a842f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.727465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b5728-42f9-414c-ab28-e30ba90a842f service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.741628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 825/1640] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:00.808706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd743c-3645-4c22-8993-8f13bada6154 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:00.817587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:00.818755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:00.819036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:00.820706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] PATH_INFO: `/v3/users/39a64f307d82492eaa1d34ce6f0925de` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:00.822346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a64f307d82492eaa1d34ce6f0925de)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:00.824311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:00.920602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a64f307d82492eaa1d34ce6f0925de'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:00.941872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a64f307d82492eaa1d34ce6f0925de'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:00.973037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a64f307d82492eaa1d34ce6f0925de'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:00.975432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a64f307d82492eaa1d34ce6f0925de'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:00.977355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a64f307d82492eaa1d34ce6f0925de'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:01.019571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 816/1641] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:00 2022] DELETE /identity/v3/users/39a64f307d82492eaa1d34ce6f0925de => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:01.021889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca0202-c219-4742-8175-47c08f4cf618 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:01.022433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca0202-c219-4742-8175-47c08f4cf618 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:01.022545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca0202-c219-4742-8175-47c08f4cf618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:01.055316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ddca0202-c219-4742-8175-47c08f4cf618 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:01.060212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ddca0202-c219-4742-8175-47c08f4cf618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:01.203213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 826/1642] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:01.220060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:01.221552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:01.355225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c478a1-474b-41b1-9c14-d240758141db admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:01.363000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:01.364860 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:01.366290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:01.367881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:01.383985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:01.385887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:01.406353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 817/1643] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:01.660505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a5ac6-90e2-4922-8c80-3c6545c50ec4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:01.661670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a5ac6-90e2-4922-8c80-3c6545c50ec4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:01.662124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a5ac6-90e2-4922-8c80-3c6545c50ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:01.711432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-fc5a5ac6-90e2-4922-8c80-3c6545c50ec4 None None] MFA Rules not processed for user `53133ebe47414bb392ffeaca71a1f342`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:01.712853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fc5a5ac6-90e2-4922-8c80-3c6545c50ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:01.843313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:01.850124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 827/1644] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:01.850583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:01.907415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388391b2-adc8-4b38-9523-7a24eb92db0f service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:01.938881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e16e-3b8a-4128-aab3-95aada0a1834 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:01.939726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e16e-3b8a-4128-aab3-95aada0a1834 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:01.940207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e16e-3b8a-4128-aab3-95aada0a1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:01.942473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:01.943403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:01.949838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:01.951976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:01.952740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:01.954712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.030720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e197e16e-3b8a-4128-aab3-95aada0a1834 None None] MFA Rules not processed for user `3a343c19dc5f4ca1bcf659d05ffa92c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:02.032953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e197e16e-3b8a-4128-aab3-95aada0a1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:02.052964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 818/1645] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:01 2022] POST /identity/v3/projects => generated 405 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:02.053906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:02.184952 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 828/1646] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:02.187203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.187494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.187775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.197305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48e18-1b09-4a20-b1e3-149776943e23 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:02.203994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:02.205305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.205754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.206537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.207682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:02.209954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.220025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] MFA Rules not processed for user `3a343c19dc5f4ca1bcf659d05ffa92c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:02.224109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:02.243379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 819/1647] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:02 2022] POST /identity/v3/users => generated 309 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:02.249878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:02.272324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd5108-0b51-4262-9e4d-ff0727d4c1a9 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:02.289346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:02.290070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.290358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.290640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.291380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:02.295297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.310354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 829/1648] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:02.324676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:02.326409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:02.328925 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 820/1649] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:02.334584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:02.362863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8355c2-66f6-49ff-99f2-380932d6e86d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:02.371933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:02.374436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.374436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.374436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] PATH_INFO: `/v3/projects/4d659a584f344f2187be122e6ab4d24c/users/b46bbabdce8544389a28090f7b068b01/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.455981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d659a584f344f2187be122e6ab4d24c, user_id=b46bbabdce8544389a28090f7b068b01, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:02.458487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eec61-0109-47cc-af9a-cfbe2616b500 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:02.459820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.465553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:02.466366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.466764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.467493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.482233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:02.484949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 821/1650] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:02 2022] PUT /identity/v3/projects/4d659a584f344f2187be122e6ab4d24c/users/b46bbabdce8544389a28090f7b068b01/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:02.488628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:02.500667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.539240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 830/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:02.613359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ce50f-a688-4143-927c-22c627496d7d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:02.638850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:02.639680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.640068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.640466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.641300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:02.643040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.671399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 822/1652] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:02.675687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:02.697786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed84aae-6404-4cf2-a181-a7ce9357e780 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:02.716629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40820c-304e-4cb8-b877-e78594e3e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:02.717758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40820c-304e-4cb8-b877-e78594e3e749 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:02.718071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40820c-304e-4cb8-b877-e78594e3e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:02.718481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40820c-304e-4cb8-b877-e78594e3e749 admin admin] PATH_INFO: `/v3/projects/4d659a584f344f2187be122e6ab4d24c/users/b46bbabdce8544389a28090f7b068b01/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:02.724501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40820c-304e-4cb8-b877-e78594e3e749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d659a584f344f2187be122e6ab4d24c, user_id=b46bbabdce8544389a28090f7b068b01, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:02.728323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40820c-304e-4cb8-b877-e78594e3e749 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:02.755289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 831/1653] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:02 2022] PUT /identity/v3/projects/4d659a584f344f2187be122e6ab4d24c/users/b46bbabdce8544389a28090f7b068b01/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:03.080427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:03.084596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:03.123202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d6760-428f-44e4-9ad3-5596161ef9cf admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:03.249381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:03.250463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.250864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.251252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] PATH_INFO: `/v3/projects/e46d176642e64537baf1e1b72fc1632c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.252630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46d176642e64537baf1e1b72fc1632c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:03.253755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: WARNING py.warnings [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:51:03.253755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: warnings.warn(msg) Mar 08 14:51:03.253755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: Mar 08 14:51:03.256112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:03.416713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46d176642e64537baf1e1b72fc1632c', 'request_id': 'req-3d3690f4-6a3a-4402-ac63-10916e7799f4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:03.435909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46d176642e64537baf1e1b72fc1632c', 'request_id': 'req-3d3690f4-6a3a-4402-ac63-10916e7799f4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:03.467799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46d176642e64537baf1e1b72fc1632c', 'request_id': 'req-3d3690f4-6a3a-4402-ac63-10916e7799f4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:03.478583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8464-00e9-48ca-9735-521c229412f9 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.479681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8464-00e9-48ca-9735-521c229412f9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.480176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8464-00e9-48ca-9735-521c229412f9 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.482883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 832/1654] 10.222.0.30 () {54 vars in 912 bytes} [Tue Mar 8 14:51:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 14:51:03.490006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.490643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.491168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.491293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] The token cache is being invalidate because project e46d176642e64537baf1e1b72fc1632c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:03.492581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:03.494998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3d3690f4-6a3a-4402-ac63-10916e7799f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:03.498870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 823/1655] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:03 2022] DELETE /identity/v3/projects/e46d176642e64537baf1e1b72fc1632c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:03.508099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498d783-f060-480a-a9ac-ad7091fc55c7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.511915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498d783-f060-480a-a9ac-ad7091fc55c7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.512304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498d783-f060-480a-a9ac-ad7091fc55c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.561298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-3498d783-f060-480a-a9ac-ad7091fc55c7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:03.566389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3498d783-f060-480a-a9ac-ad7091fc55c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:03.599505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] MFA Rules not processed for user `e45b81aa59fd4b26bc1434c9191c20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:03.601813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:03.655516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 824/1656] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:03.664033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.664477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.665052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.691521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:03.692868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:03.704665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 825/1657] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:03.710412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:03.720326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 833/1658] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:51:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:03.725307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4511d-58d1-4208-a28d-1a2be958c5e6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:03.731916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:03.733202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.733572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.733967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.734963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:03.735411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:03.738317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:03.758873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:03.759020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 826/1659] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:51:03.778865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70882123-1608-45bb-8dbe-26f2208fb5a5 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:03.780106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:03.783745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:03.789667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:03.791018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.791487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.791947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.792912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:03.795164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:03.806249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a8b4-3b0d-4c86-ab1e-c72e3aa8f057 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:03.810516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:03.811372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.811800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.812251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.821823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:03.825193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:03.834586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 834/1660] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:03 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:03.838626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:03.843593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 827/1661] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:03.926442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e343a-6633-4373-9e78-a1bac5bdfdf7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:03.934393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:03.935324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:03.935986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:03.936526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:03.937467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:03.940331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:03.987016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 835/1662] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:03 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:03.991728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:04.006531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5084ea-923c-4b44-8d72-f681a4e7abf4 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:04.017508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:04.020287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.020804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.021344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.022298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:04.025796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:04.049968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 828/1663] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:04.051240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:04.062243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f110a-c471-4707-b1a7-6d5bc4bd77c4 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:04.069267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f03c2-60bf-4452-9bc1-0f8a0102cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:04.070005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f03c2-60bf-4452-9bc1-0f8a0102cbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.070305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f03c2-60bf-4452-9bc1-0f8a0102cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.074276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f03c2-60bf-4452-9bc1-0f8a0102cbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.074592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f03c2-60bf-4452-9bc1-0f8a0102cbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:04.078473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f03c2-60bf-4452-9bc1-0f8a0102cbc5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:04.096865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 836/1664] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:04.102731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:04.116979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86cf83-ef5b-479c-8088-fce50ac76271 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:04.125750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:04.127071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.127805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.128260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] PATH_INFO: `/v3/projects/96d9ba5926cd404d91ab0d2243f65849/users/032b412280634e7d84fffc78c3bbff2c/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.164375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d9ba5926cd404d91ab0d2243f65849, user_id=032b412280634e7d84fffc78c3bbff2c, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:04.168074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:04.195217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 829/1665] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:04 2022] PUT /identity/v3/projects/96d9ba5926cd404d91ab0d2243f65849/users/032b412280634e7d84fffc78c3bbff2c/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:04.207348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.207632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.208108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.277923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] MFA Rules not processed for user `032b412280634e7d84fffc78c3bbff2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:04.279209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:04.486128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 837/1666] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:04.491635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:04.677178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1b52-3c3b-4ad6-8dc5-9cfc98fd1a43 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:04.682965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:04.683646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.683926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.684198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.684893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:04.686897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:04.742910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 830/1667] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:04 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:04.746991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:04.761026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda4f5-c6a7-4bee-888e-16f9d81a4f12 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:04.892450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:04.893168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.893453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.893732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.894483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:04.897391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:04.934713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 838/1668] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:04 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:04.939422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:04.961540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce5428-d408-4c7f-af49-fec0afe7b819 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:04.969705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:04.971466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:04.972405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:04.972405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:04.972738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:04.974431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:04.999357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 831/1669] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:05.003928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:05.024736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d03d2-0b3a-4893-85ab-0289b09af55b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:05.039925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:05.040844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:05.041132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:05.041409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] PATH_INFO: `/v3/projects/8ac0be16b6be493f89eb9493e89bf498/users/27b9d84483f44a28a8c0ebc7cfe3ecfb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:05.083527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac0be16b6be493f89eb9493e89bf498, user_id=27b9d84483f44a28a8c0ebc7cfe3ecfb, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:05.087416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:05.119956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 839/1670] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:05 2022] PUT /identity/v3/projects/8ac0be16b6be493f89eb9493e89bf498/users/27b9d84483f44a28a8c0ebc7cfe3ecfb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:05.121124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:05.141413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd338-3b7d-4739-a1e1-aa301dea6b0e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:05.338562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7862d-680d-4aaa-80bb-0f92c5946f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:05.342035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7862d-680d-4aaa-80bb-0f92c5946f2f admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:05.349309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7862d-680d-4aaa-80bb-0f92c5946f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:05.351376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7862d-680d-4aaa-80bb-0f92c5946f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:05.354330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7862d-680d-4aaa-80bb-0f92c5946f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:05.370026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7862d-680d-4aaa-80bb-0f92c5946f2f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:05.434291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 832/1671] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:05.436179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:05.453820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfc7fa-0fdc-48be-ad96-4c382e396ad5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:05.470159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7706196-b131-4bbd-82d7-4c834eddeede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:05.472125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7706196-b131-4bbd-82d7-4c834eddeede admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:05.473388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7706196-b131-4bbd-82d7-4c834eddeede admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:05.474319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7706196-b131-4bbd-82d7-4c834eddeede admin admin] PATH_INFO: `/v3/projects/8ac0be16b6be493f89eb9493e89bf498/users/27b9d84483f44a28a8c0ebc7cfe3ecfb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:05.481006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7706196-b131-4bbd-82d7-4c834eddeede admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac0be16b6be493f89eb9493e89bf498, user_id=27b9d84483f44a28a8c0ebc7cfe3ecfb, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:05.489763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7706196-b131-4bbd-82d7-4c834eddeede admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:05.518399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 840/1672] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:05 2022] PUT /identity/v3/projects/8ac0be16b6be493f89eb9493e89bf498/users/27b9d84483f44a28a8c0ebc7cfe3ecfb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:05.531813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ee0d-bac4-4dff-be1e-233691182d63 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:05.534162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ee0d-bac4-4dff-be1e-233691182d63 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:05.534989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40ee0d-bac4-4dff-be1e-233691182d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:05.582270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:05.582734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:05.583899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:05.612920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ff40ee0d-bac4-4dff-be1e-233691182d63 None None] MFA Rules not processed for user `27b9d84483f44a28a8c0ebc7cfe3ecfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:05.614642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ff40ee0d-bac4-4dff-be1e-233691182d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:05.646558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] MFA Rules not processed for user `b46bbabdce8544389a28090f7b068b01`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:05.647881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:05.882069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 833/1673] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:05.883876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c277-38de-4f68-a73d-d25177f95015 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:05.884172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c277-38de-4f68-a73d-d25177f95015 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:05.884581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c277-38de-4f68-a73d-d25177f95015 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:05.886730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 834/1674] 10.222.0.30 () {54 vars in 960 bytes} [Tue Mar 8 14:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:51:05.888355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c277-38de-4f68-a73d-d25177f95015 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:05.889065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 841/1675] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:05.890018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:05.896949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4488c277-38de-4f68-a73d-d25177f95015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:05.897144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.014053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097188c-720c-4d68-8380-da0d9aebfe31 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:06.021377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f7d61-8f53-4eb5-8316-831c40b89566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:06.022346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7d61-8f53-4eb5-8316-831c40b89566 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.022886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7d61-8f53-4eb5-8316-831c40b89566 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.023239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7d61-8f53-4eb5-8316-831c40b89566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.040138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c277-38de-4f68-a73d-d25177f95015 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:06.044632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f7d61-8f53-4eb5-8316-831c40b89566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:06.046569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f7d61-8f53-4eb5-8316-831c40b89566 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:06.054389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:06.055303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.055588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.055864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] PATH_INFO: `/v3/users/66ec6695b3034373864880f974042903` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.062957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ec6695b3034373864880f974042903)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:06.068384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 842/1676] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:06.071186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:06.072994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.073363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.073709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.123098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] MFA Rules not processed for user `aa5f9bb835104f1c95d0ccc6ddd02de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:06.124736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.142587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ec6695b3034373864880f974042903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.164568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ec6695b3034373864880f974042903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.200912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ec6695b3034373864880f974042903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.202735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ec6695b3034373864880f974042903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.206627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-1ff01a5f-e421-4a20-b855-41b10642ae67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ec6695b3034373864880f974042903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.235374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 835/1677] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:05 2022] DELETE /identity/v3/users/66ec6695b3034373864880f974042903 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:06.242126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.242614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.243462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.304126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:06.306794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.340740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 843/1678] 10.222.0.30 () {58 vars in 1057 bytes} [Tue Mar 8 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:06.374823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:06.392538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bcc49-d9f9-4e09-a523-a1841c3859d2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:06.518009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 836/1679] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:06.553901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:06.557333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.564326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:06.564731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.565048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.565848 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.568560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.580371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2c7a7-0380-4715-8ffa-649d5f7dd8fc None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:06.582690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:06.585190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:06.597416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:06.599384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 844/1680] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:06.599542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.599831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.600108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] PATH_INFO: `/v3/users/032b412280634e7d84fffc78c3bbff2c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.601032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:06.601444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032b412280634e7d84fffc78c3bbff2c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:06.603164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.603457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:06.673571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7156-14d8-48e6-bb0d-6c0610830081 service placement] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:06.679062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5cb83-64d1-4f6b-ab5b-5d86f5ee4cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:06.679937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5cb83-64d1-4f6b-ab5b-5d86f5ee4cab service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.680386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5cb83-64d1-4f6b-ab5b-5d86f5ee4cab service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.680800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5cb83-64d1-4f6b-ab5b-5d86f5ee4cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.693613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5cb83-64d1-4f6b-ab5b-5d86f5ee4cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:06.694438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032b412280634e7d84fffc78c3bbff2c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.695497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5cb83-64d1-4f6b-ab5b-5d86f5ee4cab service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:06.705563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032b412280634e7d84fffc78c3bbff2c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.709000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 845/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:06.721833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032b412280634e7d84fffc78c3bbff2c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.723555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032b412280634e7d84fffc78c3bbff2c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.724253 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032b412280634e7d84fffc78c3bbff2c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:06.741971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 837/1682] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:06 2022] DELETE /identity/v3/users/032b412280634e7d84fffc78c3bbff2c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:06.746174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:06.746632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:06.746913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:06.776840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:06.778514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:06.978988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 846/1683] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:07.343491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:07.346469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:07.644012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482aea-ca9a-4dc9-b497-a14f5c2fe286 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:07.660159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:07.664074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:07.664384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:07.667219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:07.709767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:07.711930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:07.739639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 838/1684] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:08.600279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:08.601798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:08.620967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd488e-d3c9-4a1a-9b64-9885c698179f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:08.630865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:08.631757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:08.632050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:08.632310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] PATH_INFO: `/v3/projects/29ec0be7f0e14c159f69c6f88937306f` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:08.633522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ec0be7f0e14c159f69c6f88937306f)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:08.639361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:08.741212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ec0be7f0e14c159f69c6f88937306f', 'request_id': 'req-793fb8fd-8e5f-425c-9445-1de77b442bb5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:08.751944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ec0be7f0e14c159f69c6f88937306f', 'request_id': 'req-793fb8fd-8e5f-425c-9445-1de77b442bb5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:08.759321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ec0be7f0e14c159f69c6f88937306f', 'request_id': 'req-793fb8fd-8e5f-425c-9445-1de77b442bb5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:08.780905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] The token cache is being invalidate because project 29ec0be7f0e14c159f69c6f88937306f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:08.781197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:08.782092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:08.785973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 847/1685] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:08 2022] DELETE /identity/v3/projects/29ec0be7f0e14c159f69c6f88937306f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:08.790902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:08.803689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11375058-f329-4bb2-8408-25c2e901fe05 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:08.862338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:08.864356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:08.956785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:08.958321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:08.958605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:08.958982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] PATH_INFO: `/v3/users/fcf74d4064ee482ab150a170f359c845` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:08.960240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf74d4064ee482ab150a170f359c845)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:08.962229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:09.036825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fb8fd-8e5f-425c-9445-1de77b442bb5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:09.042047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:09.042926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:09.043207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:09.043476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] PATH_INFO: `/v3/projects/96d9ba5926cd404d91ab0d2243f65849` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:09.044899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d9ba5926cd404d91ab0d2243f65849)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:09.047033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:09.060825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf74d4064ee482ab150a170f359c845'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.081102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf74d4064ee482ab150a170f359c845'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.115944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf74d4064ee482ab150a170f359c845'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.117812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf74d4064ee482ab150a170f359c845'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.121827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf74d4064ee482ab150a170f359c845'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.166420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d9ba5926cd404d91ab0d2243f65849', 'request_id': 'req-8dc3b17a-ff84-4896-8c71-6bf923143006'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.179894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 839/1686] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:08 2022] DELETE /identity/v3/users/fcf74d4064ee482ab150a170f359c845 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:09.183141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d9ba5926cd404d91ab0d2243f65849', 'request_id': 'req-8dc3b17a-ff84-4896-8c71-6bf923143006'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.198153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d9ba5926cd404d91ab0d2243f65849', 'request_id': 'req-8dc3b17a-ff84-4896-8c71-6bf923143006'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.228485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] The token cache is being invalidate because project 96d9ba5926cd404d91ab0d2243f65849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:09.229332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.229551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8dc3b17a-ff84-4896-8c71-6bf923143006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.231189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 848/1687] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:08 2022] DELETE /identity/v3/projects/96d9ba5926cd404d91ab0d2243f65849 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:09.235710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:09.238137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:09.449668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35380-9851-49e9-a8b9-59bb8d7fa5ca admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:09.465675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:09.468310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:09.469616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:09.470077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] PATH_INFO: `/v3/users/27b9d84483f44a28a8c0ebc7cfe3ecfb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:09.473928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b9d84483f44a28a8c0ebc7cfe3ecfb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:09.480370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:09.642045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b9d84483f44a28a8c0ebc7cfe3ecfb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.662369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b9d84483f44a28a8c0ebc7cfe3ecfb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.693314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b9d84483f44a28a8c0ebc7cfe3ecfb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.698592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b9d84483f44a28a8c0ebc7cfe3ecfb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.699349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b9d84483f44a28a8c0ebc7cfe3ecfb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:09.736416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 840/1688] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:09 2022] DELETE /identity/v3/users/27b9d84483f44a28a8c0ebc7cfe3ecfb => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:10.028257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:10.029378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:10.029881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:10.055555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:10.057054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:10.198173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 849/1689] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:10.571472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:10.573136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:10.711500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfce66-4368-46ec-a89d-cfccac696f4a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:10.762716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:10.765680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:10.766004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:10.766291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:10.787038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:10.789758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:10.803667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:10.812246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:10.838508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 841/1690] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:51:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:51:10.887793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:10.891432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:10.954544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c145e4-a673-49fb-a859-9438aac6f1ed None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:10.965285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:10.970008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:10.970401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:10.970685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] PATH_INFO: `/v3/users/ee12a6f5fb244832a4701a63861e5fa5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:10.980612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee12a6f5fb244832a4701a63861e5fa5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:10.981979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: WARNING py.warnings [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:51:10.981979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: warnings.warn(msg) Mar 08 14:51:10.981979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: Mar 08 14:51:10.987701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:11.105742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30682f3a-7a8a-4443-9941-847201958005 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:11.130736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:11.131799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:11.132089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:11.132445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] PATH_INFO: `/v3/projects/f2167e65dfc0489694e238937b7cd8bf` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:11.138127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2167e65dfc0489694e238937b7cd8bf)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:11.140284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:11.216082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee12a6f5fb244832a4701a63861e5fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.242416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee12a6f5fb244832a4701a63861e5fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.291077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2167e65dfc0489694e238937b7cd8bf', 'request_id': 'req-5b569b09-d6e6-46bc-8127-b2d3805576c0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.300060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee12a6f5fb244832a4701a63861e5fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.302778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee12a6f5fb244832a4701a63861e5fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.305694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2167e65dfc0489694e238937b7cd8bf', 'request_id': 'req-5b569b09-d6e6-46bc-8127-b2d3805576c0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.322573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2167e65dfc0489694e238937b7cd8bf', 'request_id': 'req-5b569b09-d6e6-46bc-8127-b2d3805576c0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.354968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f21401ae-9ad2-4469-abbe-e557456f3181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee12a6f5fb244832a4701a63861e5fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.378192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 850/1691] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:10 2022] DELETE /identity/v3/users/ee12a6f5fb244832a4701a63861e5fa5 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:11.379835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aa7ea-25e7-4c14-b421-fef80c52160e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:11.380450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aa7ea-25e7-4c14-b421-fef80c52160e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:11.380877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aa7ea-25e7-4c14-b421-fef80c52160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:11.381268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] The token cache is being invalidate because project f2167e65dfc0489694e238937b7cd8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:11.381749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.384140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b569b09-d6e6-46bc-8127-b2d3805576c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:11.390293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 842/1692] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:10 2022] DELETE /identity/v3/projects/f2167e65dfc0489694e238937b7cd8bf => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:11.394028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:11.395139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:11.395630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:11.437140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7b2aa7ea-25e7-4c14-b421-fef80c52160e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:11.439208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7b2aa7ea-25e7-4c14-b421-fef80c52160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:11.492403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:11.496826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:11.625452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 851/1693] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:11.696964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 843/1694] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:11.707016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:11.707427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:11.707907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:11.757053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:11.768821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:11.810312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:11.814633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:11.819698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 852/1695] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:11.826858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:11.862446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfcba7-80a3-42bf-8a32-4cb557b8bc7e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:11.875763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:11.876447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:11.882810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:11.883450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:11.895792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:11.898378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:11.909954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:11.944313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 853/1696] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:11.946869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:11.969443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f486340-95c8-4976-a2ea-dbac65fb5b3a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:11.988282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:11.989495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:11.989772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:11.990068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:11.990759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:11.992730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.083210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 854/1697] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:11 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:12.084215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:12.089064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:12.105278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773735-aca9-4966-9782-b6ffada8b32f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.269745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4c5ba-eddc-49a8-8124-77025f570707 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.292668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.295135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.295928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.296407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.296598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.296898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.297175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] PATH_INFO: `/v3/projects/8ac0be16b6be493f89eb9493e89bf498` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.298428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.298557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac0be16b6be493f89eb9493e89bf498)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:12.301319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.340058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:12.345215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.380869 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 844/1698] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:12.385622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:12.419445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fe072-9207-4de5-bfe9-2d97ea58d300 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.473466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac0be16b6be493f89eb9493e89bf498', 'request_id': 'req-29cbce5b-0198-4a26-b0d1-a5c73097a3db'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:12.508007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac0be16b6be493f89eb9493e89bf498', 'request_id': 'req-29cbce5b-0198-4a26-b0d1-a5c73097a3db'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:12.522052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac0be16b6be493f89eb9493e89bf498', 'request_id': 'req-29cbce5b-0198-4a26-b0d1-a5c73097a3db'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:12.553535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] The token cache is being invalidate because project 8ac0be16b6be493f89eb9493e89bf498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:12.554065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:12.555134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29cbce5b-0198-4a26-b0d1-a5c73097a3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:12.558683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 855/1699] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:12 2022] DELETE /identity/v3/projects/8ac0be16b6be493f89eb9493e89bf498 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:12.563802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897a4c-dc87-4fb1-ae61-94106e98e64d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.564431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897a4c-dc87-4fb1-ae61-94106e98e64d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.564805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97897a4c-dc87-4fb1-ae61-94106e98e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.606449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-97897a4c-dc87-4fb1-ae61-94106e98e64d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:12.607961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-97897a4c-dc87-4fb1-ae61-94106e98e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:12.620807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.622300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.624227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.624713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.625590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:12.632397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.690179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 845/1700] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:12 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:12.694854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:12.699831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:12.730784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c6ba-82ea-44e8-b168-af74a096652c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.742492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.743887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.744699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.745441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.746672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:12.749953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.751259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 856/1701] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:12.768443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.768867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.769246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.788152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 846/1702] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:12.794526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:12.822680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:12.824271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:12.826805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c1ca-4b94-4c55-8e1d-a3b4c5c89dcf admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.844293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.845309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.845692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.846116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.846960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:12.849284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.856716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 857/1703] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:12.859080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:12.884342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 847/1704] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:12.888370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184e58-3e7f-4bf5-93bd-0dcb81c6ed35 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.889221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:12.916452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.917330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.917721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.918148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.918985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:12.919452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:12.921326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:12.927353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f611e-8c63-41bc-8ee4-bb5c0701cf99 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:12.961137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59af954-6475-4a9c-8b75-63589efdfba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:12.963060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59af954-6475-4a9c-8b75-63589efdfba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:12.964456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59af954-6475-4a9c-8b75-63589efdfba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:12.964905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59af954-6475-4a9c-8b75-63589efdfba7 admin admin] PATH_INFO: `/v3/projects/0701849dc24b42a08d3e4d4c74501152/users/7898d0f4947a47b7b1d0d277254a7e1a/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:12.984429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 858/1705] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:12.985959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.020824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dac97-4056-4c95-8cf3-6b6a44e022e8 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.045390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.049666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.050239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.054203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.058878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.063624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.087920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59af954-6475-4a9c-8b75-63589efdfba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701849dc24b42a08d3e4d4c74501152, user_id=7898d0f4947a47b7b1d0d277254a7e1a, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.093705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59af954-6475-4a9c-8b75-63589efdfba7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.135041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 859/1706] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:12 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:13.135041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.160772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 848/1707] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:12 2022] PUT /identity/v3/projects/0701849dc24b42a08d3e4d4c74501152/users/7898d0f4947a47b7b1d0d277254a7e1a/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:13.163930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.164234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.164528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.233232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] MFA Rules not processed for user `7898d0f4947a47b7b1d0d277254a7e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:13.235666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:13.310260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6d08-3a33-421c-8c7b-6bc84b005286 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.339967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.341042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.341576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.342180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.343358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.345485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.410789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 860/1708] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:13 2022] POST /identity/v3/users => generated 282 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:13.417407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.427279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 849/1709] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:13.435258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.452258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036f70-8409-47f5-961a-50bf4bf1fb04 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.485968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.486768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031a0d-5301-45c7-8ef4-bcb501bdd48f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.488081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.488613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.489048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.490002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.494236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.495012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.495264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.495550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.497458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.500845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.504062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.543495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 861/1710] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:13.550493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.559843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:13.574086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 850/1711] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:13 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:13.575366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.602391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d7f6-eb57-4ed6-93d3-23e44854e8c0 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.748487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7150e8f-7b6a-4ccd-a58e-446f4c96e2b0 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.764056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.765715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.766025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.766307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] PATH_INFO: `/v3/users/53133ebe47414bb392ffeaca71a1f342` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.767059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.767810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.768145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.768565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.771300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53133ebe47414bb392ffeaca71a1f342)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.773425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.775123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.777136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.814743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 851/1712] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:13.815646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.850758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3a14-263d-483a-b942-d98bb74c9cfb admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.859497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:13.860457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:13.860854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:13.861269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:13.862326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:13.870228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:13.917643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53133ebe47414bb392ffeaca71a1f342'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:13.953688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53133ebe47414bb392ffeaca71a1f342'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:13.960159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 852/1713] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:13 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:13.960159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:13.979805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767fd0e-0e5b-4a3d-a271-edd3608dabcf admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:13.983698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53133ebe47414bb392ffeaca71a1f342'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:13.984890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53133ebe47414bb392ffeaca71a1f342'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:13.993436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639480f-c944-4b74-892b-00dd3d0037d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:14.007063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639480f-c944-4b74-892b-00dd3d0037d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.007479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639480f-c944-4b74-892b-00dd3d0037d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.007770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639480f-c944-4b74-892b-00dd3d0037d8 admin admin] PATH_INFO: `/v3/projects/0a81bf79a9e2428887752ec2bc8b499e/users/27063fff06fe4dc89b178f76a774dc23/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.010896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53133ebe47414bb392ffeaca71a1f342'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:14.025063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 862/1714] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:13 2022] DELETE /identity/v3/users/53133ebe47414bb392ffeaca71a1f342 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:14.026523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:14.029594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:14.043028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639480f-c944-4b74-892b-00dd3d0037d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a81bf79a9e2428887752ec2bc8b499e, user_id=27063fff06fe4dc89b178f76a774dc23, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:14.056107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639480f-c944-4b74-892b-00dd3d0037d8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:14.112848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 853/1715] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:13 2022] PUT /identity/v3/projects/0a81bf79a9e2428887752ec2bc8b499e/users/27063fff06fe4dc89b178f76a774dc23/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:14.127270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.128325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.128856 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.208816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] MFA Rules not processed for user `27063fff06fe4dc89b178f76a774dc23`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:14.213656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:14.265018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3b63-e909-40d4-afcb-4114ac948b7b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:14.423361 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 854/1716] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:14.435871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:14.440040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:14.509765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:14.510654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.511042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.511426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.512271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:14.514478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:14.542732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 863/1717] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:14.548074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:14.565026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee8dd-788e-4ae0-a480-87b13f9999e6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:14.578604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8dcb7-9c21-4e71-b583-6503ed3e8495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:14.582173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8dcb7-9c21-4e71-b583-6503ed3e8495 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.582783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8dcb7-9c21-4e71-b583-6503ed3e8495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.583433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8dcb7-9c21-4e71-b583-6503ed3e8495 admin admin] PATH_INFO: `/v3/projects/29e87d18fe2f480a8e3f2ccb670b4d58/users/85d13b86a99841dfa6c16ab269dd3dc8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.616595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcecef-cc3b-4d04-94e6-4ccb8af069c5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:14.632805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:14.633210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8dcb7-9c21-4e71-b583-6503ed3e8495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e87d18fe2f480a8e3f2ccb670b4d58, user_id=85d13b86a99841dfa6c16ab269dd3dc8, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:14.633503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.633790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.634830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.635531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:14.640103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:14.642325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8dcb7-9c21-4e71-b583-6503ed3e8495 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:14.684579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 864/1718] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:14 2022] PUT /identity/v3/projects/29e87d18fe2f480a8e3f2ccb670b4d58/users/85d13b86a99841dfa6c16ab269dd3dc8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:14.689354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.694916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.696528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.720934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 855/1719] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:14 2022] POST /identity/v3/projects => generated 361 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:14.721921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:14.764820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] MFA Rules not processed for user `e45b81aa59fd4b26bc1434c9191c20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:14.770805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:14.963804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 865/1720] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Mar 8 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:14.964154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866de09-d56f-4c09-9f75-de069ad565a2 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:14.965469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:14.977513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:14.978544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:14.993250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:14.993654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:14.997774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:14.999756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.000723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89907a0-8112-49a4-98ad-603d764058b3 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.012455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.014819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.016194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.017302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.018647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.024122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.045033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 856/1721] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:15.063438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.076828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 866/1722] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:14 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:15.078021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.090559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b32440-de02-4d4f-9d4f-d31e5a050bd8 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.106264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc35aba-5bc0-4291-ab20-26ea4604fad1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.118174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.118870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.119146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.119417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.120292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.121093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.121988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.124902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.125200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.128888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] PATH_INFO: `/v3/projects/29e87d18fe2f480a8e3f2ccb670b4d58/users/85d13b86a99841dfa6c16ab269dd3dc8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.134252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e87d18fe2f480a8e3f2ccb670b4d58, user_id=85d13b86a99841dfa6c16ab269dd3dc8, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.146120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.155936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 867/1723] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:15.157032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.159547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:15.191476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c146-d72c-4f5f-bb47-607d91469423 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.192337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 857/1724] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:15 2022] PUT /identity/v3/projects/29e87d18fe2f480a8e3f2ccb670b4d58/users/85d13b86a99841dfa6c16ab269dd3dc8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:15.193225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.389786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6d518-e570-41db-930b-4476d9b50607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.392342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d518-e570-41db-930b-4476d9b50607 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.392480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d518-e570-41db-930b-4476d9b50607 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.392699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d518-e570-41db-930b-4476d9b50607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.424169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6d518-e570-41db-930b-4476d9b50607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.430259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6d518-e570-41db-930b-4476d9b50607 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.462338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 868/1725] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:15.466116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.466417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.466697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.471922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee275-5941-4096-b0dc-c0a0ccacb7c8 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.529118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.533263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.533613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.533919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] PATH_INFO: `/v3/projects/590bbad6d9314dc582c7d467fc14694c/users/65c37b1ca15a4b44a11952ce333ca351/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.553428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] MFA Rules not processed for user `85d13b86a99841dfa6c16ab269dd3dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:15.558048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:15.618914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590bbad6d9314dc582c7d467fc14694c, user_id=65c37b1ca15a4b44a11952ce333ca351, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.621999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.659085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 858/1726] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:15 2022] PUT /identity/v3/projects/590bbad6d9314dc582c7d467fc14694c/users/65c37b1ca15a4b44a11952ce333ca351/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:15.660545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.776985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 869/1727] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:15.776985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.779454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:15.826539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a9fae-a5e6-42d5-8f9b-6fc04f1a4a32 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.846895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.849702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3f23a-ab1e-4a27-8ca8-905d6c0fe942 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:15.852832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.853138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.853422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] PATH_INFO: `/v3/projects/c2e68f7ac86d45539e8fa393fee88cb5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.860010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e68f7ac86d45539e8fa393fee88cb5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.866736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:15.867984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:15.868413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:15.868520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.868954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:15.869877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:15.871738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:15.905827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 859/1728] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:15.916103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:15.921806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.030542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e68f7ac86d45539e8fa393fee88cb5', 'request_id': 'req-04397cf1-2508-4178-8cfa-4d053cd67350'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.047166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e68f7ac86d45539e8fa393fee88cb5', 'request_id': 'req-04397cf1-2508-4178-8cfa-4d053cd67350'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.067614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e68f7ac86d45539e8fa393fee88cb5', 'request_id': 'req-04397cf1-2508-4178-8cfa-4d053cd67350'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.094929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] The token cache is being invalidate because project c2e68f7ac86d45539e8fa393fee88cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:16.095225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.096923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.102000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 870/1729] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:15 2022] DELETE /identity/v3/projects/c2e68f7ac86d45539e8fa393fee88cb5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:16.102884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:16.108576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.110865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa37a8-3ed4-46c7-b6ba-64eeda0fcc9a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:16.228851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:16.230102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:16.233041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:16.233512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:16.244575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.249798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04397cf1-2508-4178-8cfa-4d053cd67350 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:16.260089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:16.261161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:16.261469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:16.262087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] PATH_INFO: `/v3/projects/590bbad6d9314dc582c7d467fc14694c/users/65c37b1ca15a4b44a11952ce333ca351/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:16.264111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590bbad6d9314dc582c7d467fc14694c, user_id=65c37b1ca15a4b44a11952ce333ca351, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:16.267008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:16.289596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 871/1730] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:16 2022] PUT /identity/v3/projects/590bbad6d9314dc582c7d467fc14694c/users/65c37b1ca15a4b44a11952ce333ca351/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:16.289596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:16.294489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.415077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:16.416775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b98ce9-30f6-49db-be79-f63af7f606bf service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:16.419138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acc863-f02f-4a73-8533-f036a9230fd4 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:16.425272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:16.427430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:16.427721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:16.428063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] PATH_INFO: `/v3/users/b46bbabdce8544389a28090f7b068b01` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:16.430064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46bbabdce8544389a28090f7b068b01)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:16.432394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:16.438226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 860/1731] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:16.453694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b95bd-496e-455d-a059-0745bb482670 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:16.454160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b95bd-496e-455d-a059-0745bb482670 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:16.454607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b95bd-496e-455d-a059-0745bb482670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:16.485167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-680b95bd-496e-455d-a059-0745bb482670 None None] MFA Rules not processed for user `65c37b1ca15a4b44a11952ce333ca351`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:16.487687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-680b95bd-496e-455d-a059-0745bb482670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.530176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46bbabdce8544389a28090f7b068b01'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.560086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46bbabdce8544389a28090f7b068b01'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.581826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46bbabdce8544389a28090f7b068b01'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.585096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46bbabdce8544389a28090f7b068b01'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.602032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46bbabdce8544389a28090f7b068b01'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:16.612809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 872/1732] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:16 2022] DELETE /identity/v3/users/b46bbabdce8544389a28090f7b068b01 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:16.690316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:16.692459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.706327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 861/1733] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:16.717473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b95bd-496e-455d-a059-0745bb482670 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:16.719530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-680b95bd-496e-455d-a059-0745bb482670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:16.856899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b95bd-496e-455d-a059-0745bb482670 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:16.890888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370b69-dcfa-4a9b-8a28-6331b0a3b30a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:16.902772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:16.903689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:16.903971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:16.904247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] PATH_INFO: `/v3/users/7898d0f4947a47b7b1d0d277254a7e1a` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:16.905767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7898d0f4947a47b7b1d0d277254a7e1a)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:16.907882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:16.986808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea22b7-cfaf-4f30-acfa-0df6767aed1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:16.989030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea22b7-cfaf-4f30-acfa-0df6767aed1c service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:16.990123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea22b7-cfaf-4f30-acfa-0df6767aed1c service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:16.990814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea22b7-cfaf-4f30-acfa-0df6767aed1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:17.054658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7898d0f4947a47b7b1d0d277254a7e1a'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.077870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7898d0f4947a47b7b1d0d277254a7e1a'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.136457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7898d0f4947a47b7b1d0d277254a7e1a'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.138882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7898d0f4947a47b7b1d0d277254a7e1a'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.162927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ceb39482-100e-4a73-ba25-c0dfe12b9a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7898d0f4947a47b7b1d0d277254a7e1a'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.174620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea22b7-cfaf-4f30-acfa-0df6767aed1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:17.180747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea22b7-cfaf-4f30-acfa-0df6767aed1c service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:17.184599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 873/1734] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:16 2022] DELETE /identity/v3/users/7898d0f4947a47b7b1d0d277254a7e1a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:17.189960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15a07-862a-4387-904a-f74f8334cbda None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:17.190370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15a07-862a-4387-904a-f74f8334cbda None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:17.190653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15a07-862a-4387-904a-f74f8334cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:17.212552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 862/1735] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:17.215096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:17.216284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:17.218247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:17.264945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d7f15a07-862a-4387-904a-f74f8334cbda None None] MFA Rules not processed for user `00aa26c0dc804f949002193e1919183d`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:17.266511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d7f15a07-862a-4387-904a-f74f8334cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:17.286982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:17.291413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:17.345710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 874/1736] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:17.361276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b87f0-df4b-4494-979f-01e14322669c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:17.366283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b87f0-df4b-4494-979f-01e14322669c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:17.366917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b87f0-df4b-4494-979f-01e14322669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:17.477256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-527b87f0-df4b-4494-979f-01e14322669c None None] MFA Rules not processed for user `00aa26c0dc804f949002193e1919183d`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:17.479258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-527b87f0-df4b-4494-979f-01e14322669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:17.518455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 875/1737] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:17.519808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b87f0-df4b-4494-979f-01e14322669c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:17.525965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-527b87f0-df4b-4494-979f-01e14322669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:17.590964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 863/1738] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:17.598874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:17.603535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:17.640519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068bdcb-64da-41b8-be6b-bdfb56c56fb2 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:17.657445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:17.659745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:17.660821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:17.662403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] PATH_INFO: `/v3/projects/4d659a584f344f2187be122e6ab4d24c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:17.667173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d659a584f344f2187be122e6ab4d24c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:17.673144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:17.782203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b87f0-df4b-4494-979f-01e14322669c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:17.839919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d659a584f344f2187be122e6ab4d24c', 'request_id': 'req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.862050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d659a584f344f2187be122e6ab4d24c', 'request_id': 'req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.900588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:17.900884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d659a584f344f2187be122e6ab4d24c', 'request_id': 'req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.901593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:17.902073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:17.902504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:17.905671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:17.928622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] The token cache is being invalidate because project 4d659a584f344f2187be122e6ab4d24c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:17.928919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.933002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:17.961273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 864/1739] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:17 2022] DELETE /identity/v3/projects/4d659a584f344f2187be122e6ab4d24c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:17.962497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:17.974044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.102311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:18.111119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:18.139101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 876/1740] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:18.141658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:18.155686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.190207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ea3cc-c75f-4304-bb2d-1b59dd1fcde5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:18.202833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:18.203596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.203953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.204318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.208891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.267715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682d5a-5812-4124-9b59-7aea46bec1c0 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:18.281652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:18.282267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.282540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.282823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.287214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.407702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:18.407702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:18.428883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 865/1741] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:18.432094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:18.435716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.497841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:18.499801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09240f34-9cc4-4fb0-8f68-1b64c218905b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:18.530542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 877/1742] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:18.541021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded441f-4ac1-41b2-9c58-73eb31405c85 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.542421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded441f-4ac1-41b2-9c58-73eb31405c85 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.542705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded441f-4ac1-41b2-9c58-73eb31405c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.675484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0ded441f-4ac1-41b2-9c58-73eb31405c85 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:18.680600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0ded441f-4ac1-41b2-9c58-73eb31405c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.712660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451fad-cabf-4c5c-a2de-cc83232a5157 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:18.716304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 878/1743] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:18.725782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c7b2-2fc9-4237-880b-9469240d0781 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.727788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c7b2-2fc9-4237-880b-9469240d0781 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.730160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425c7b2-2fc9-4237-880b-9469240d0781 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.735214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:18.736052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.736496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.736603 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] PATH_INFO: `/v3/projects/d21b9d56eff240819bd69978a7a10992` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.737928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21b9d56eff240819bd69978a7a10992)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:18.740681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:18.742435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 879/1744] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:51:18 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:51:18.745017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.745017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.746489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.799196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:18.801265 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:18.817989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 880/1745] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:18.822383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:18.842894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d255e3-366e-43f3-98de-0562df89ddae None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:18.868953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21b9d56eff240819bd69978a7a10992', 'request_id': 'req-35c5c000-87e7-456a-a9ca-273d896d4410'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:18.894887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21b9d56eff240819bd69978a7a10992', 'request_id': 'req-35c5c000-87e7-456a-a9ca-273d896d4410'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:18.909908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21b9d56eff240819bd69978a7a10992', 'request_id': 'req-35c5c000-87e7-456a-a9ca-273d896d4410'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:18.935228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] The token cache is being invalidate because project d21b9d56eff240819bd69978a7a10992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:18.937009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:18.939867 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-35c5c000-87e7-456a-a9ca-273d896d4410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:18.944231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 866/1746] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:18 2022] DELETE /identity/v3/projects/d21b9d56eff240819bd69978a7a10992 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:18.950001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34f7c4-c0c2-4126-8584-04e5f618c815 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.950153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34f7c4-c0c2-4126-8584-04e5f618c815 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.954309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34f7c4-c0c2-4126-8584-04e5f618c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.985400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:18.987784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:18.988748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:18.989107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:18.989992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:18.994562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:18.997017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.014466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-3f34f7c4-c0c2-4126-8584-04e5f618c815 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:19.021427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3f34f7c4-c0c2-4126-8584-04e5f618c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:19.032443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 881/1747] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:51:19.033907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.037508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 867/1748] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:19.043954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:19.045327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9f6f-2532-48c2-9bf0-3a2624115fe5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.045772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9f6f-2532-48c2-9bf0-3a2624115fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.046906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9f6f-2532-48c2-9bf0-3a2624115fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.084830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24207e-5d01-498e-b8fd-a0747d192d3c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.098378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2c4a9f6f-2532-48c2-9bf0-3a2624115fe5 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:19.102120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2c4a9f6f-2532-48c2-9bf0-3a2624115fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:19.111073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.111904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.112194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.114316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.115915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.122654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.126245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 868/1749] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:19.128236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.129780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.130713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.180169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:19.188718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:19.212084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 882/1750] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:19 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:19.212084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.341932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 869/1751] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:19.342879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.371722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb260-6fbe-4609-a5f6-a9b025725e87 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.434543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b6b3e-4507-42ca-b05e-9b89e9706cbe admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.461953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.465040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.465382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.465705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.468075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:19.471747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.483014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.498304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.498304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.498573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.498769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.499438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.501578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.529581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 883/1752] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:19.539709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.547970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 870/1753] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:19 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:19.547970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.552514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:19.564831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f02282-27e7-44a2-b42a-c046f771c13b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.579962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.584092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.584391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.584674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.585397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.587375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.648765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 871/1754] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:19 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:19.649519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.731188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd764d-1bf9-4f58-8fe3-bd6cab4ddd68 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.766398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa769e6a-a8b3-43f4-9b9f-072461502943 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.772160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.772855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.773130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.773411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.774273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.775920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.795126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 872/1755] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:19.795126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.831342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2369f-beb1-4529-a3d8-8bbbfbd50bfd admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.859838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.861065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.861626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.862147 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.863263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.869692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:19.922673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 873/1756] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:19 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:19.924775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:19.948636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0065f3-e2a0-4859-9bb0-212543ec8735 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:19.962990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac71c-8f77-4d32-8e25-3d2d932fbfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:19.970209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac71c-8f77-4d32-8e25-3d2d932fbfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:19.970690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac71c-8f77-4d32-8e25-3d2d932fbfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:19.971241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac71c-8f77-4d32-8e25-3d2d932fbfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:19.973124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac71c-8f77-4d32-8e25-3d2d932fbfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:19.989027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac71c-8f77-4d32-8e25-3d2d932fbfd3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:20.006058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 874/1757] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:20.007041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:20.007571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.007795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.008111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.008920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.009564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.010827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.035895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:20.037842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:20.053086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 884/1758] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:20.054002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:20.067741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69c901-0ac4-41c4-9aa6-0d1cfde47409 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:20.079484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:20.080320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.080511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.080783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.081512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:20.091734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:20.094091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] MFA Rules not processed for user `1775260bd3f947ea85d14b3a1aa80b38`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:20.096962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:20.212086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 885/1759] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:20.212990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:20.251779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7309f-0027-4945-8bd0-41d1f5a6ba6e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:20.260252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:20.261504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.261909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.262293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] PATH_INFO: `/v3/projects/7fda8792d8394004b130a8eb1267b4a3/users/3d37651f374d4f48aabba62ed12a9835/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.295875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 875/1760] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:20.295875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:20.303966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fda8792d8394004b130a8eb1267b4a3, user_id=3d37651f374d4f48aabba62ed12a9835, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:20.306940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:20.321232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12c346-c56b-4cbc-a204-a92417cb3935 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:20.336474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61836-053b-4ad4-b9a5-c33c2e56855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:20.337349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61836-053b-4ad4-b9a5-c33c2e56855c admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.337634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61836-053b-4ad4-b9a5-c33c2e56855c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.338019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61836-053b-4ad4-b9a5-c33c2e56855c admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.338647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61836-053b-4ad4-b9a5-c33c2e56855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:20.339487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 886/1761] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:20 2022] PUT /identity/v3/projects/7fda8792d8394004b130a8eb1267b4a3/users/3d37651f374d4f48aabba62ed12a9835/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:20.341336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:20.351411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61836-053b-4ad4-b9a5-c33c2e56855c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:20.388072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 876/1762] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:20.389476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.389778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.390094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.498325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d08a18-7833-4beb-9211-57e6773b66d6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:20.504154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] MFA Rules not processed for user `3d37651f374d4f48aabba62ed12a9835`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:20.505657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:20.507834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:20.513002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:20.513542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:20.514036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:20.703830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:20.705884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:20.716811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 877/1763] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:20.716811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:20.778094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 887/1764] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:20.780026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:20.785058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:21.017636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e534007-139e-4acf-9d63-57df3158e544 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:21.032388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:21.033732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:21.034075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:21.034368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] PATH_INFO: `/v3/projects/d817121f6e0c411291e59bffcb786867/users/e0a6c41a496942d5a4ad87278443a686/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:21.081267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d817121f6e0c411291e59bffcb786867, user_id=e0a6c41a496942d5a4ad87278443a686, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:21.084404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:21.097882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d46ef-6bc5-40c6-919b-54e867fc73d2 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:21.119337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:21.120297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:21.120569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:21.121922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] PATH_INFO: `/v3/projects/0701849dc24b42a08d3e4d4c74501152` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:21.123678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 878/1765] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:20 2022] PUT /identity/v3/projects/d817121f6e0c411291e59bffcb786867/users/e0a6c41a496942d5a4ad87278443a686/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:21.153958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:21.156098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0701849dc24b42a08d3e4d4c74501152)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:21.168586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:21.294634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0701849dc24b42a08d3e4d4c74501152', 'request_id': 'req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:21.319083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0701849dc24b42a08d3e4d4c74501152', 'request_id': 'req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:21.340772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0701849dc24b42a08d3e4d4c74501152', 'request_id': 'req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:21.392826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] The token cache is being invalidate because project 0701849dc24b42a08d3e4d4c74501152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:21.392826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:21.392826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4346f77b-863a-4af1-a6a6-b2e74cd3d5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:21.392826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 888/1766] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:20 2022] DELETE /identity/v3/projects/0701849dc24b42a08d3e4d4c74501152 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:21.394960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dafb-2888-4c80-8add-ed7049a6ac19 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:21.403000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dafb-2888-4c80-8add-ed7049a6ac19 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:21.403377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dafb-2888-4c80-8add-ed7049a6ac19 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:21.413927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 889/1767] 10.222.0.30 () {54 vars in 912 bytes} [Tue Mar 8 14:51:21 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:51:21.416400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9132-0eb5-4433-8686-6231aff1031c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:21.416705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9132-0eb5-4433-8686-6231aff1031c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:21.422160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9132-0eb5-4433-8686-6231aff1031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:21.453053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e7096-8dea-4d9c-a454-1f5c3d737f80 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:21.518796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5f8a9132-0eb5-4433-8686-6231aff1031c None None] MFA Rules not processed for user `e0a6c41a496942d5a4ad87278443a686`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:21.520116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5f8a9132-0eb5-4433-8686-6231aff1031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:21.705246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 890/1768] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:21.709967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06739a3a-9a9e-410c-952e-9efbae6d68d6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:21.711809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06739a3a-9a9e-410c-952e-9efbae6d68d6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:21.715876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06739a3a-9a9e-410c-952e-9efbae6d68d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:21.745758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:21.750000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:21.750995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:21.753068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:21.755483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:21.793433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:21.795854 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-06739a3a-9a9e-410c-952e-9efbae6d68d6 None None] MFA Rules not processed for user `51ed61d0a16d465889c0474a4d2b7dee`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:21.797281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-06739a3a-9a9e-410c-952e-9efbae6d68d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:21.971584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 879/1769] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:21 2022] POST /identity/v3/projects => generated 367 bytes in 844 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:21.971584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:21.976131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.042506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 891/1770] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:22.043999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:22.044341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:22.044546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:22.088373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] MFA Rules not processed for user `e45b81aa59fd4b26bc1434c9191c20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:22.093073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.223949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207419c5-48f4-4a5a-a8e8-f0c31380ecb1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:22.244689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:22.246007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:22.246461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:22.247087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] PATH_INFO: `/v3/users/85d13b86a99841dfa6c16ab269dd3dc8` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:22.250482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d13b86a99841dfa6c16ab269dd3dc8)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:22.252824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:22.292562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 892/1771] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:22.293414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:22.298690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.334270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296f8ae-67be-4fc5-ba72-75fd9a311d61 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:22.362635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:22.363564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:22.363898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:22.364201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:22.365317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:22.367528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:22.438664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 893/1772] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:22 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:22.440103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:22.443671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.447833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d13b86a99841dfa6c16ab269dd3dc8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:22.466542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d13b86a99841dfa6c16ab269dd3dc8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:22.507136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d13b86a99841dfa6c16ab269dd3dc8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:22.510689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d13b86a99841dfa6c16ab269dd3dc8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:22.517042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d13b86a99841dfa6c16ab269dd3dc8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:22.548912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 880/1773] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:21 2022] DELETE /identity/v3/users/85d13b86a99841dfa6c16ab269dd3dc8 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:22.550035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:22.571019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.606490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a702d-350c-44f0-aef8-d52d0915c975 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:22.748860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:22.750246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:22.750712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:22.751138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:22.751987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:22.755440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:22.782051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 894/1774] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:22 2022] POST /identity/v3/users => generated 290 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:22.783564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:22.786516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.803268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198634e-f88a-4086-b1df-fc3655260470 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:22.809420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:22.819004 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:22.819835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:22.820338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:22.821339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:22.824873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:22.860850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 895/1775] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:22 2022] POST /identity/v3/users => generated 293 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:22.865325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:22.866282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd754-573a-4143-aac6-65403761a78e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:22.872170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:22.882445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:22.883377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:22.883675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:22.883945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:22.888346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.048501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479595f2-a02f-45dc-be5a-87b5003f69cc admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.056874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.058431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.059109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.059245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.059540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.060440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.068499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.081286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 881/1776] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:23.083341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.084969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.111647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.113687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.139891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5ad6-284e-4f94-9ffb-24950ca123bb service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.152676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.153610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 896/1777] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:23.154740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.155991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.156289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.156585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] PATH_INFO: `/v3/users/27063fff06fe4dc89b178f76a774dc23` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.158890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.160559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=27063fff06fe4dc89b178f76a774dc23)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.165305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.199157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d090a9-b47f-4e77-8112-06f8f7dafca9 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.226367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.227181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.227576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.228403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.229363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.235183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.298763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 897/1778] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:23.305722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.325145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27063fff06fe4dc89b178f76a774dc23'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:23.340230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aef171-bbb0-4257-8078-a79fb37bad40 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.345910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27063fff06fe4dc89b178f76a774dc23'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:23.364287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.366078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.366937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.367957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.369141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.373398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.392344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 898/1779] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:23.393768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.402866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27063fff06fe4dc89b178f76a774dc23'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:23.403758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27063fff06fe4dc89b178f76a774dc23'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:23.404535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27063fff06fe4dc89b178f76a774dc23'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:23.407990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781d88-ee00-4f47-b750-a0e0feb74553 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.414450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.415931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.416640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.417108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] PATH_INFO: `/v3/projects/31e0010f141141c388c5484b9e216e5a/users/a74cab8f9eda4f00ae4f75a3598cda9c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.443352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 882/1780] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:23 2022] DELETE /identity/v3/users/27063fff06fe4dc89b178f76a774dc23 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:23.444696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.448265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.459638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e0010f141141c388c5484b9e216e5a, user_id=a74cab8f9eda4f00ae4f75a3598cda9c, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.464545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.496957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 899/1781] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:23 2022] PUT /identity/v3/projects/31e0010f141141c388c5484b9e216e5a/users/a74cab8f9eda4f00ae4f75a3598cda9c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:23.506165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.509569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.657123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f234adb-0414-43fa-9d32-2766e12592ab admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.706003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbaf6-d293-4e35-a571-be6ee2b01e90 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:23.720389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d6305-a70c-42b5-85b6-efa97fba1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.723007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6305-a70c-42b5-85b6-efa97fba1e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.723597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6305-a70c-42b5-85b6-efa97fba1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.724102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d6305-a70c-42b5-85b6-efa97fba1e4c admin admin] PATH_INFO: `/v3/projects/d2c15dea794c4d7ea499b49456ca7ea4/users/0f70ff485cdf45f1b84f4fc9c46a3d60/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.769759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d6305-a70c-42b5-85b6-efa97fba1e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c15dea794c4d7ea499b49456ca7ea4, user_id=0f70ff485cdf45f1b84f4fc9c46a3d60, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.774949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d6305-a70c-42b5-85b6-efa97fba1e4c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.804973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 900/1782] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:23 2022] PUT /identity/v3/projects/d2c15dea794c4d7ea499b49456ca7ea4/users/0f70ff485cdf45f1b84f4fc9c46a3d60/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:23.807797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.808581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.809899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.849075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:23.850072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:23.850364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:23.850814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] PATH_INFO: `/v3/projects/29e87d18fe2f480a8e3f2ccb670b4d58` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:23.850938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:23.852617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e87d18fe2f480a8e3f2ccb670b4d58)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:23.853113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.855259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:23.978572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e87d18fe2f480a8e3f2ccb670b4d58', 'request_id': 'req-14674d57-fa4d-47c3-a648-b43ba4b0d713'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:23.985663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 901/1783] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:23.986853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:23.994859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:23.999310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e87d18fe2f480a8e3f2ccb670b4d58', 'request_id': 'req-14674d57-fa4d-47c3-a648-b43ba4b0d713'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:24.018773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312cad-31bb-4182-8ff7-2970c18bb37a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:24.019130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e87d18fe2f480a8e3f2ccb670b4d58', 'request_id': 'req-14674d57-fa4d-47c3-a648-b43ba4b0d713'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:24.055477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] The token cache is being invalidate because project 29e87d18fe2f480a8e3f2ccb670b4d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:24.055871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:24.056639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:24.058820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 883/1784] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:23 2022] DELETE /identity/v3/projects/29e87d18fe2f480a8e3f2ccb670b4d58 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:24.059909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:24.068592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.156200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a50f58-3965-4abc-8cbc-559f647a31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:24.157052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a50f58-3965-4abc-8cbc-559f647a31a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.157480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a50f58-3965-4abc-8cbc-559f647a31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.157888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a50f58-3965-4abc-8cbc-559f647a31a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.164193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a50f58-3965-4abc-8cbc-559f647a31a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:24.165823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a50f58-3965-4abc-8cbc-559f647a31a8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:24.178569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 902/1785] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:24.180159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.180458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.180742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.265379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:24.267470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.286272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 903/1786] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:24.287931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:24.292000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.359569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14674d57-fa4d-47c3-a648-b43ba4b0d713 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:24.378037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:24.380127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.380383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.380589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.385069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:24.392577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:24.424051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 884/1787] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:24.433980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:24.441393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.498271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56cfd8-5483-4279-bd28-edb0183b3869 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:24.508955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c44b-9562-435c-a034-33e91403e8b9 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:24.513709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd19011-9fc5-4b6a-9cc0-283d6401b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:24.516968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:24.517456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19011-9fc5-4b6a-9cc0-283d6401b301 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.517635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.517790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19011-9fc5-4b6a-9cc0-283d6401b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.517970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.518190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19011-9fc5-4b6a-9cc0-283d6401b301 admin admin] PATH_INFO: `/v3/projects/31e0010f141141c388c5484b9e216e5a/users/a74cab8f9eda4f00ae4f75a3598cda9c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.518289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.525866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.526064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19011-9fc5-4b6a-9cc0-283d6401b301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e0010f141141c388c5484b9e216e5a, user_id=a74cab8f9eda4f00ae4f75a3598cda9c, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:24.532593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19011-9fc5-4b6a-9cc0-283d6401b301 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:24.561556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 885/1788] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:24 2022] PUT /identity/v3/projects/31e0010f141141c388c5484b9e216e5a/users/a74cab8f9eda4f00ae4f75a3598cda9c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:24.562931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2556-0de5-42a7-814d-a4add054da1f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.566887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2556-0de5-42a7-814d-a4add054da1f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.567234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2556-0de5-42a7-814d-a4add054da1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.619829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:24.623318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-cc5a2556-0de5-42a7-814d-a4add054da1f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:24.626406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:24.627102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cc5a2556-0de5-42a7-814d-a4add054da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.671742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 904/1789] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:24.674688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:24.701050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66812c-55e8-4f74-bd25-92ad0dd9fc01 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:24.810477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 886/1790] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:24.812994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9fd4-6baf-4112-af12-94ee8d9f0d32 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.813382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9fd4-6baf-4112-af12-94ee8d9f0d32 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.826296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c9fd4-6baf-4112-af12-94ee8d9f0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:24.908954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a86c9fd4-6baf-4112-af12-94ee8d9f0d32 None None] MFA Rules not processed for user `a74cab8f9eda4f00ae4f75a3598cda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:24.919427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a86c9fd4-6baf-4112-af12-94ee8d9f0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:24.985008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:24.991578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:24.993628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:24.993991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] PATH_INFO: `/v3/projects/d2c15dea794c4d7ea499b49456ca7ea4/users/0f70ff485cdf45f1b84f4fc9c46a3d60/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.000490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c15dea794c4d7ea499b49456ca7ea4, user_id=0f70ff485cdf45f1b84f4fc9c46a3d60, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:25.011452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:25.058661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 905/1791] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:24 2022] PUT /identity/v3/projects/d2c15dea794c4d7ea499b49456ca7ea4/users/0f70ff485cdf45f1b84f4fc9c46a3d60/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:25.060424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:25.166110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 887/1792] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:25.166110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:25.166110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:25.166110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.223871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] MFA Rules not processed for user `0f70ff485cdf45f1b84f4fc9c46a3d60`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:25.225656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:25.320895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef943e-1838-4de8-8814-1e2dc9e8e47c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:25.341210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:25.342002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:25.342287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:25.342585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.343302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:25.343624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:25.345422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e528-f20b-4e04-aa38-409ba0f0cc3b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:25.383928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 888/1793] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:25.387760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 906/1794] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:25.387899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:25.387899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:25.396602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:25.396903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:25.397186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.470012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] MFA Rules not processed for user `00aa26c0dc804f949002193e1919183d`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:25.475372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:25.544156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f7300-4c41-403c-952a-7b3223a4fe05 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:25.556139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:25.557177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:25.558285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:25.558741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.639806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 907/1795] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:25.641106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:25.644043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:25.672850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ff0e-532d-4827-ba00-532aa58c3591 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:25.682035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:25.682877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:25.683442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:25.683686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.705767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:25.707537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:25.738679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:25.740071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 908/1796] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:25.741119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:25.747260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:25.771893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea3760-265e-4870-99b8-c6df8bf30654 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:25.795958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 889/1797] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:25.806594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:25.807407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:25.807799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:25.813348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:25.816544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:25.824847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:25.921715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 909/1798] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:25 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:25.924124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:25.999235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fd5c1-0b31-4629-bcf7-cd0b95566227 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:26.351797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:26.352941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:26.353058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:26.353375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:26.354418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:26.356974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:26.420577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 890/1799] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:25 2022] POST /identity/v3/users => generated 305 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:26.424563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:26.448408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575825b-9f2b-468c-b0d8-4f19e96fd452 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:26.463377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:26.465937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:26.466234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:26.466820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:26.468537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:26.470492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:26.507480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:26.515169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 910/1800] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:26.523378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c452cf-51d6-4f1c-a7f6-0e10f2ba80fe admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:26.534632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:26.537204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:26.537720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:26.539619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:26.540684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:26.544301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:26.547473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:26.549943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:26.581507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c4ac-25f9-4c57-9ed3-63968318b8fa admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:26.590410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 891/1801] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:26.592484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:26.598654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:26.602000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:26.603490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:26.603916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] PATH_INFO: `/v3/projects/0a81bf79a9e2428887752ec2bc8b499e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:26.609904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a81bf79a9e2428887752ec2bc8b499e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:26.612268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:26.620742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327a793-6fc6-433c-a592-4c9189cd00ad admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:26.637765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aedde5-1ac6-4c8c-9f05-d792322cafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:26.639034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aedde5-1ac6-4c8c-9f05-d792322cafad admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:26.641002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aedde5-1ac6-4c8c-9f05-d792322cafad admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:26.642175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aedde5-1ac6-4c8c-9f05-d792322cafad admin admin] PATH_INFO: `/v3/projects/85f99487b1e649de952b335d1fb065d7/users/5a8d4554b12143b18119bc15bf1e48da/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:26.690309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aedde5-1ac6-4c8c-9f05-d792322cafad admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f99487b1e649de952b335d1fb065d7, user_id=5a8d4554b12143b18119bc15bf1e48da, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:26.694541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aedde5-1ac6-4c8c-9f05-d792322cafad admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:26.717235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a81bf79a9e2428887752ec2bc8b499e', 'request_id': 'req-9129238b-631a-4b35-a175-b471f49ab220'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:26.730390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a81bf79a9e2428887752ec2bc8b499e', 'request_id': 'req-9129238b-631a-4b35-a175-b471f49ab220'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:26.749755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 892/1802] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:26 2022] PUT /identity/v3/projects/85f99487b1e649de952b335d1fb065d7/users/5a8d4554b12143b18119bc15bf1e48da/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:26.755659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:26.756455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:26.757067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a81bf79a9e2428887752ec2bc8b499e', 'request_id': 'req-9129238b-631a-4b35-a175-b471f49ab220'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:26.758221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:26.802789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] The token cache is being invalidate because project 0a81bf79a9e2428887752ec2bc8b499e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:26.803147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:26.805395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:26.811204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 911/1803] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:26 2022] DELETE /identity/v3/projects/0a81bf79a9e2428887752ec2bc8b499e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:26.811880 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:26.816648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:26.834673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] MFA Rules not processed for user `5a8d4554b12143b18119bc15bf1e48da`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:26.836712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:27.003461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 893/1804] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:27.005646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:27.009708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:27.030505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129238b-631a-4b35-a175-b471f49ab220 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:27.193341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:27.196911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:27.197309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:27.197688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] PATH_INFO: `/v3/users/65c37b1ca15a4b44a11952ce333ca351` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:27.199996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c37b1ca15a4b44a11952ce333ca351)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:27.203522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:27.216834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b648c-a583-431e-a2a7-e03074a7ac4c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:27.230183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:27.232881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:27.233971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:27.234367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] PATH_INFO: `/v3/users/e0a6c41a496942d5a4ad87278443a686` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:27.241014 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a6c41a496942d5a4ad87278443a686)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:27.251845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:27.348341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c37b1ca15a4b44a11952ce333ca351'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.381867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c37b1ca15a4b44a11952ce333ca351'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.395159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a6c41a496942d5a4ad87278443a686'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.402540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c37b1ca15a4b44a11952ce333ca351'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.403606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c37b1ca15a4b44a11952ce333ca351'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.413756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a6c41a496942d5a4ad87278443a686'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.417038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c37b1ca15a4b44a11952ce333ca351'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.432893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 912/1805] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:26 2022] DELETE /identity/v3/users/65c37b1ca15a4b44a11952ce333ca351 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:27.434787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:27.441894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a6c41a496942d5a4ad87278443a686'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.442078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:27.443136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a6c41a496942d5a4ad87278443a686'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.445295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d825acf-50d9-4479-ad8f-dba7cd8b1d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a6c41a496942d5a4ad87278443a686'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:27.466763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 894/1806] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:27 2022] DELETE /identity/v3/users/e0a6c41a496942d5a4ad87278443a686 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:27.471170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:27.471751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:27.472811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:27.520129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:27.526388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:27.619642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 895/1807] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:27.652575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:27.654287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:27.710891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0d83f-7482-4629-bea2-9ed35b4583b3 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:27.724155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:27.724842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:27.726975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:27.727271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:27.727993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:27.735839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:27.787258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af59950-5bed-4a38-8755-be79283b5405 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:27.799470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:27.801432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:27.801648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:27.802528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 913/1808] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:27 2022] POST /identity/v3/projects => generated 407 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:27.813337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:27.813427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:27.815809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:27.840810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:27.848597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:27.899780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 896/1809] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:27.993157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320272-1d9d-41af-82ca-41e082c8a1b4 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:28.027914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0054003-8c35-48f5-8330-6bb3056138e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:28.028617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054003-8c35-48f5-8330-6bb3056138e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.029051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054003-8c35-48f5-8330-6bb3056138e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.032863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054003-8c35-48f5-8330-6bb3056138e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.033691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0054003-8c35-48f5-8330-6bb3056138e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:28.041649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0054003-8c35-48f5-8330-6bb3056138e4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:28.103849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 914/1810] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:27 2022] POST /identity/v3/users => generated 310 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:28.109542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:28.126263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788c5e-b059-414c-8b7f-7c6ba94e0cc8 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:28.163917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:28.164610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.164894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.168210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.171665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:28.181059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:28.220765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.221064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.221441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.233185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 897/1811] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:28.240761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:28.263402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0b4d-3c60-47be-ba97-108e130241e5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:28.270711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:28.271754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.272039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.272411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] PATH_INFO: `/v3/projects/8b673d6b75e645dcab7f40bc6a452452/users/8ccad48cb81c4d0ca76d1b20a0857756/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.274588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] MFA Rules not processed for user `51ed61d0a16d465889c0474a4d2b7dee`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:28.276155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:28.294807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b673d6b75e645dcab7f40bc6a452452, user_id=8ccad48cb81c4d0ca76d1b20a0857756, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:28.330114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:28.375898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 898/1812] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:28 2022] PUT /identity/v3/projects/8b673d6b75e645dcab7f40bc6a452452/users/8ccad48cb81c4d0ca76d1b20a0857756/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:28.378076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:28.455502 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 915/1813] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:28.665640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef3f0-fe2d-4d19-9057-cc44dc3e2f9e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:28.680287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65f8a1-4887-4ab8-bd61-5cc43b733af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:28.681002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f8a1-4887-4ab8-bd61-5cc43b733af9 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.681277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f8a1-4887-4ab8-bd61-5cc43b733af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.682388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f8a1-4887-4ab8-bd61-5cc43b733af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.683722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65f8a1-4887-4ab8-bd61-5cc43b733af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:28.685502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65f8a1-4887-4ab8-bd61-5cc43b733af9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:28.721728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 899/1814] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:28.723532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:28.743793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37999d-c28b-4ea9-a527-5c251f158e44 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:28.800188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:28.801528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.803303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.803734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] PATH_INFO: `/v3/projects/8b673d6b75e645dcab7f40bc6a452452/users/8ccad48cb81c4d0ca76d1b20a0857756/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.811414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b673d6b75e645dcab7f40bc6a452452, user_id=8ccad48cb81c4d0ca76d1b20a0857756, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:28.820385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:28.855468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 916/1815] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:28 2022] PUT /identity/v3/projects/8b673d6b75e645dcab7f40bc6a452452/users/8ccad48cb81c4d0ca76d1b20a0857756/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:28.868333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:28.868630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:28.868917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:28.903717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] MFA Rules not processed for user `8ccad48cb81c4d0ca76d1b20a0857756`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:28.905372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.080734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:29.086035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.142470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 900/1816] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:29.155706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:29.157247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.303206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1003b2-08a2-4b6b-937a-1ee382e60670 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:29.313131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:29.314804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.315280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.315785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] PATH_INFO: `/v3/projects/590bbad6d9314dc582c7d467fc14694c` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.318037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] RBAC: Authorizing `identity:delete_project(project_id=590bbad6d9314dc582c7d467fc14694c)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:29.323820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:29.343579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf8db6-fd3e-41b2-896c-a89a37cf1366 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:29.353217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296c00-4514-4caf-9f1e-bdc74fe2681d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:29.353217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296c00-4514-4caf-9f1e-bdc74fe2681d service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.353522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296c00-4514-4caf-9f1e-bdc74fe2681d service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.353739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296c00-4514-4caf-9f1e-bdc74fe2681d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.382800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296c00-4514-4caf-9f1e-bdc74fe2681d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:29.384823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296c00-4514-4caf-9f1e-bdc74fe2681d service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:29.428115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 901/1817] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:29.428336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590bbad6d9314dc582c7d467fc14694c', 'request_id': 'req-eb3dad3e-42e7-4737-bf25-f8232535206d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.437634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590bbad6d9314dc582c7d467fc14694c', 'request_id': 'req-eb3dad3e-42e7-4737-bf25-f8232535206d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.443435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa69fd-ef19-4167-b184-dceb71116a8a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.443737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa69fd-ef19-4167-b184-dceb71116a8a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.444020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa69fd-ef19-4167-b184-dceb71116a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.452833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590bbad6d9314dc582c7d467fc14694c', 'request_id': 'req-eb3dad3e-42e7-4737-bf25-f8232535206d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.471547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] The token cache is being invalidate because project 590bbad6d9314dc582c7d467fc14694c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:29.474687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.475878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.481948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 917/1818] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:29 2022] DELETE /identity/v3/projects/590bbad6d9314dc582c7d467fc14694c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:29.483241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:29.485079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.490840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-15aa69fd-ef19-4167-b184-dceb71116a8a None None] MFA Rules not processed for user `1775260bd3f947ea85d14b3a1aa80b38`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:29.492870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-15aa69fd-ef19-4167-b184-dceb71116a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.606107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dad3e-42e7-4737-bf25-f8232535206d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:29.615252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:29.615678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.615955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.616225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] PATH_INFO: `/v3/users/3d37651f374d4f48aabba62ed12a9835` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.617448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d37651f374d4f48aabba62ed12a9835)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:29.619439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:29.641870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 902/1819] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:29.645701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44916-8f15-424a-8790-43760301e05f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.646195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44916-8f15-424a-8790-43760301e05f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.651132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44916-8f15-424a-8790-43760301e05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.700573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-fcf44916-8f15-424a-8790-43760301e05f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:29.702139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fcf44916-8f15-424a-8790-43760301e05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.718669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 903/1820] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:29.728407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf44916-8f15-424a-8790-43760301e05f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:29.730624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fcf44916-8f15-424a-8790-43760301e05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.739961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d37651f374d4f48aabba62ed12a9835'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.755670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d37651f374d4f48aabba62ed12a9835'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.775211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d37651f374d4f48aabba62ed12a9835'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.776258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d37651f374d4f48aabba62ed12a9835'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.785601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-2ba69537-9911-4b2c-a256-f304686d2824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d37651f374d4f48aabba62ed12a9835'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:29.793667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 918/1821] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:29 2022] DELETE /identity/v3/users/3d37651f374d4f48aabba62ed12a9835 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:29.795811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43368d-efef-423d-b1e1-dce77046fe72 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.796441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43368d-efef-423d-b1e1-dce77046fe72 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.796837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43368d-efef-423d-b1e1-dce77046fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.817746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0a43368d-efef-423d-b1e1-dce77046fe72 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:29.819165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0a43368d-efef-423d-b1e1-dce77046fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.896434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf44916-8f15-424a-8790-43760301e05f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:29.910606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 919/1822] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:29.914225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:29.915991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:29.916344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:29.963329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:29.971734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:29.987662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 920/1823] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:29.987662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:29.987662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.000981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6347e-4d44-453a-b086-56a2db92be64 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:30.008258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:30.009404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:30.009748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:30.010120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] PATH_INFO: `/v3/projects/d817121f6e0c411291e59bffcb786867` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:30.011795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d817121f6e0c411291e59bffcb786867)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:30.014522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:30.043204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:30.043888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:30.044173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:30.044463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:30.051485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.099175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd817121f6e0c411291e59bffcb786867', 'request_id': 'req-c0e6b8f1-0317-4030-bac0-2bde5e128424'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.111457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd817121f6e0c411291e59bffcb786867', 'request_id': 'req-c0e6b8f1-0317-4030-bac0-2bde5e128424'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.120949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd817121f6e0c411291e59bffcb786867', 'request_id': 'req-c0e6b8f1-0317-4030-bac0-2bde5e128424'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.176446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] The token cache is being invalidate because project d817121f6e0c411291e59bffcb786867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:30.179429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.192015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.201438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 921/1824] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:29 2022] DELETE /identity/v3/projects/d817121f6e0c411291e59bffcb786867 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:30.204349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:30.204838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:30.206098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:30.211227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.231123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 904/1825] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:30.233139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:30.238956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.378590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf55fc8-f4db-4d63-ae70-18980cb32352 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:30.420136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6b8f1-0317-4030-bac0-2bde5e128424 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:30.433049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:30.434443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:30.436207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:30.436504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:30.437254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:30.439942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:30.441705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:30.474727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 922/1826] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:30.475696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:30.482650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.500045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a81a7-f6b0-4366-b96c-2ed090c58852 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:30.510680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:30.526292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:30.530314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:30.530682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] PATH_INFO: `/v3/users/0f70ff485cdf45f1b84f4fc9c46a3d60` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:30.533286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f70ff485cdf45f1b84f4fc9c46a3d60)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:30.539982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:30.541183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:30.541867 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:30.542181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:30.542456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:30.548000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.565549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:30.577631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:30.605080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 905/1827] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:30.606869 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:30.627899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1276a3-7e05-45a6-807c-96ad10a2fb36 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:30.634563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:30.635501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:30.636099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:30.636904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:30.637774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:30.640083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:30.664454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f70ff485cdf45f1b84f4fc9c46a3d60'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.683946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f70ff485cdf45f1b84f4fc9c46a3d60'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.718718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f70ff485cdf45f1b84f4fc9c46a3d60'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.719642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f70ff485cdf45f1b84f4fc9c46a3d60'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.722319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 906/1828] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:30 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:30.731778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:30.737570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:30.748722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f70ff485cdf45f1b84f4fc9c46a3d60'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:30.759711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 923/1829] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:30 2022] DELETE /identity/v3/users/0f70ff485cdf45f1b84f4fc9c46a3d60 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:30.970488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e528d44-0083-4f96-971d-e6ced7d35d5a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:31.109707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:31.110380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.110660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.110976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.111631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:31.115236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:31.161278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 907/1830] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:30 2022] POST /identity/v3/users => generated 290 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:31.164912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:31.187646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a620d2-c75a-449a-b438-f5b474dac2cd admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:31.196194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:31.196890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.197170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.197444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.198215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:31.200007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:31.237676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 924/1831] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:31.243345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:31.260665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b83c6-36ed-4e99-9b9e-d7f7c3849451 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:31.266407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9b37d-f12b-4270-a21d-ca301bc592ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:31.267223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b37d-f12b-4270-a21d-ca301bc592ed admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.267511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b37d-f12b-4270-a21d-ca301bc592ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.267935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9b37d-f12b-4270-a21d-ca301bc592ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.268722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9b37d-f12b-4270-a21d-ca301bc592ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:31.273846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9b37d-f12b-4270-a21d-ca301bc592ed admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:31.296341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 908/1832] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:31.299980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:31.313893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a05a-9ab5-44d1-8ba3-4d66c850741c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:31.326101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:31.326727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.327014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.327297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] PATH_INFO: `/v3/projects/1855c136aa9c4e5bb1d73cded663835f/users/4c5bb28dde014a1784585db1690afd1b/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.345504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1855c136aa9c4e5bb1d73cded663835f, user_id=4c5bb28dde014a1784585db1690afd1b, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:31.354848 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:31.386782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 925/1833] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:31 2022] PUT /identity/v3/projects/1855c136aa9c4e5bb1d73cded663835f/users/4c5bb28dde014a1784585db1690afd1b/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:31.390837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.391662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.391953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.448955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] MFA Rules not processed for user `4c5bb28dde014a1784585db1690afd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:31.450508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:31.621791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 909/1834] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:31.626512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:31.726221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e951c-836c-42d6-927c-ee486350ceac admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:31.735146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:31.736020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.737032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.737459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.738535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:31.740756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:31.781175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 926/1835] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:31.782525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:31.807604 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc33b-0146-43c9-8d99-c6490f3412cc None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:31.962494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:31.964557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:31.966107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:31.966632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:31.970137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:31.986421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:32.013895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 910/1836] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:31 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:32.016766 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.029546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0d6c-ebdf-4755-8fec-20f5e11ecd1e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.038235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.040131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.040665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.041142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.042435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:32.045030 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:32.063004 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 927/1837] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:32.064882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.116490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f3b37-5ccc-4dc4-b724-0b4ba5cd8d6e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.132996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.133951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.136524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.136831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] PATH_INFO: `/v3/projects/74db5b7587404cb59088ba83a6dd243d/users/3378182854c74852a1d051b84292e37e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.180722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74db5b7587404cb59088ba83a6dd243d, user_id=3378182854c74852a1d051b84292e37e, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:32.183671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:32.211718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 911/1838] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:32 2022] PUT /identity/v3/projects/74db5b7587404cb59088ba83a6dd243d/users/3378182854c74852a1d051b84292e37e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:32.213913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.259498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b8b1-f4ac-4747-a393-4627fdb379fb admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.353832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.356493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:32.405128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.406320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.406820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.407290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.411445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:32.414791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:32.468130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 928/1839] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:32.478554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.495302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f568f7-4924-47f9-b297-b04b97e75e84 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.508073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e394-abdf-40aa-b78a-5593829438fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.509728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e394-abdf-40aa-b78a-5593829438fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.511554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e394-abdf-40aa-b78a-5593829438fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.512108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e394-abdf-40aa-b78a-5593829438fc admin admin] PATH_INFO: `/v3/projects/74db5b7587404cb59088ba83a6dd243d/users/3378182854c74852a1d051b84292e37e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.533521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e394-abdf-40aa-b78a-5593829438fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74db5b7587404cb59088ba83a6dd243d, user_id=3378182854c74852a1d051b84292e37e, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:32.544744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e394-abdf-40aa-b78a-5593829438fc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:32.558325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34745350-cb21-47c6-aa32-a2fbfb2ef89f admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.574660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.575038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.575325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.575605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] PATH_INFO: `/v3/projects/7fda8792d8394004b130a8eb1267b4a3` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.578226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fda8792d8394004b130a8eb1267b4a3)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:32.593402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:32.594550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 929/1840] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:32 2022] PUT /identity/v3/projects/74db5b7587404cb59088ba83a6dd243d/users/3378182854c74852a1d051b84292e37e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:32.598913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.600130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.600435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.649104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] MFA Rules not processed for user `3378182854c74852a1d051b84292e37e`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:32.651155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:32.672779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fda8792d8394004b130a8eb1267b4a3', 'request_id': 'req-d3760582-4366-4ca1-bb1a-c26cc5ab842f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:32.682449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fda8792d8394004b130a8eb1267b4a3', 'request_id': 'req-d3760582-4366-4ca1-bb1a-c26cc5ab842f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:32.709322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fda8792d8394004b130a8eb1267b4a3', 'request_id': 'req-d3760582-4366-4ca1-bb1a-c26cc5ab842f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:32.741417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] The token cache is being invalidate because project 7fda8792d8394004b130a8eb1267b4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:32.741769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:32.743232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:32.746515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 930/1841] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:32.750921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 912/1842] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:32 2022] DELETE /identity/v3/projects/7fda8792d8394004b130a8eb1267b4a3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:32.753568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.768495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:32.771775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:32.852353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10327688-c8b9-4780-97dd-553c5b64bd01 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.922123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760582-4366-4ca1-bb1a-c26cc5ab842f admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:32.927309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.927978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.928259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.928970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.931104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:32.943767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:32.945404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:32.945839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:32.946319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] PATH_INFO: `/v3/users/a74cab8f9eda4f00ae4f75a3598cda9c` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:32.947918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74cab8f9eda4f00ae4f75a3598cda9c)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:32.952746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.038135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.039669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.050384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74cab8f9eda4f00ae4f75a3598cda9c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.054362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 913/1843] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:33.062698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74cab8f9eda4f00ae4f75a3598cda9c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.088771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74cab8f9eda4f00ae4f75a3598cda9c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.090153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74cab8f9eda4f00ae4f75a3598cda9c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.104522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d2e8e792-fab9-4d05-b650-5ca77670fb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74cab8f9eda4f00ae4f75a3598cda9c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.106668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.108611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.115188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 931/1844] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:32 2022] DELETE /identity/v3/users/a74cab8f9eda4f00ae4f75a3598cda9c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:33.133528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cedec2-2765-455b-9c22-bda6ec6175c2 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:33.221747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:33.223116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.223396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.223668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] PATH_INFO: `/v3/projects/d2c15dea794c4d7ea499b49456ca7ea4` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.225475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c15dea794c4d7ea499b49456ca7ea4)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.228404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.303924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c15dea794c4d7ea499b49456ca7ea4', 'request_id': 'req-838941d0-1470-4da2-87d3-848fa61a0dbb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.320304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c15dea794c4d7ea499b49456ca7ea4', 'request_id': 'req-838941d0-1470-4da2-87d3-848fa61a0dbb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.329274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c15dea794c4d7ea499b49456ca7ea4', 'request_id': 'req-838941d0-1470-4da2-87d3-848fa61a0dbb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.351193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] The token cache is being invalidate because project d2c15dea794c4d7ea499b49456ca7ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:33.351667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.352707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-838941d0-1470-4da2-87d3-848fa61a0dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.354993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 914/1845] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:33 2022] DELETE /identity/v3/projects/d2c15dea794c4d7ea499b49456ca7ea4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:33.359960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.360363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.360737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.387674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:33.390783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.518247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 932/1846] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:33.529794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.529794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.529794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.530611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.532001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.577703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:33.583730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.615737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 915/1847] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:33.619656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.626308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.672177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddbaa8-85ba-45b0-8fa7-81c9cbfb91f4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:33.689924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c63d5-e418-4a9f-a05b-621e00e335f2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:33.690051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:33.690984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.691165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.691433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] PATH_INFO: `/v3/projects/31e0010f141141c388c5484b9e216e5a` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.693497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e0010f141141c388c5484b9e216e5a)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.695893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.696461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3378182854c74852a1d051b84292e37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74db5b7587404cb59088ba83a6dd243d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:33.697129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.697415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.697683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.698435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:33.698740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.700333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.713451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 933/1848] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:33.713451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.729437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f58845-11f8-4fc4-a6fc-f64c20b2177e tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:33.734762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:33.735501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.735785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.736058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.736775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:33.737129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.739363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.752072 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 934/1849] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:33.752804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.764995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468927e6-6502-4972-9f97-68c9f48df2df admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:33.766782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e0010f141141c388c5484b9e216e5a', 'request_id': 'req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.776804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e0010f141141c388c5484b9e216e5a', 'request_id': 'req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.783423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e0010f141141c388c5484b9e216e5a', 'request_id': 'req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.798501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] The token cache is being invalidate because project 31e0010f141141c388c5484b9e216e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:33.798501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.799521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:33.807641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 916/1850] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:33 2022] DELETE /identity/v3/projects/31e0010f141141c388c5484b9e216e5a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:33.808611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.810239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.830101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c961252-da92-4ad2-a617-56a40f1acc06 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3378182854c74852a1d051b84292e37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74db5b7587404cb59088ba83a6dd243d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:33.830866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961252-da92-4ad2-a617-56a40f1acc06 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.831214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961252-da92-4ad2-a617-56a40f1acc06 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.832232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961252-da92-4ad2-a617-56a40f1acc06 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.833172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961252-da92-4ad2-a617-56a40f1acc06 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.835174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961252-da92-4ad2-a617-56a40f1acc06 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.864711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 935/1851] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:33 2022] POST /identity/v3/projects => generated 354 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:33.866194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.866487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.866816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.880390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b111a1-a986-4e47-a3e6-22bfeb1b13cf admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:33.885697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:33.886950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.953508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1983b-fe1b-41f9-b39f-09e806f124d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:33.954274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1983b-fe1b-41f9-b39f-09e806f124d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.954552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1983b-fe1b-41f9-b39f-09e806f124d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.954829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1983b-fe1b-41f9-b39f-09e806f124d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:33.962828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 936/1852] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:33.962999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1983b-fe1b-41f9-b39f-09e806f124d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:33.963109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:33.963199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1983b-fe1b-41f9-b39f-09e806f124d8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:33.964213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:33.990307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 917/1853] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:33 2022] POST /identity/v3/projects => generated 357 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:33.990307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:33.990307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:33.990307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.011657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:34.012922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.035784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90b141-6cb1-41c9-b9e5-f89e537bd773 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.077290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 918/1854] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:34.078335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.089104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128c41d-cfbc-4a5f-9e42-04d0c639cf3b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.095430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.096166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.096563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.096839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.098273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.100193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.105687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3378182854c74852a1d051b84292e37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74db5b7587404cb59088ba83a6dd243d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.106571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.106922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.107266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.108116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:34.108735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.110582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35095e-8f85-42b7-b47c-01b73dccff10 tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.121645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 919/1855] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/users => generated 279 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:34.122578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.127199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 937/1856] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:34.128620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438968-d4e2-41dd-84ff-d49cef5d04a0 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.128971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438968-d4e2-41dd-84ff-d49cef5d04a0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.129308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438968-d4e2-41dd-84ff-d49cef5d04a0 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.131110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 938/1857] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:51:34.131872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d438968-d4e2-41dd-84ff-d49cef5d04a0 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.132392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba34e9-fe98-4dbd-86f6-09c9927ee3d2 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.137374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.138089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.138550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.138916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.139678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:34.139932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.141533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd4e83-5246-4e92-a8b2-8429236df415 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.144480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d438968-d4e2-41dd-84ff-d49cef5d04a0 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.149800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.150489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.150773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.151053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.151839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.153551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.154842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 920/1858] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:34.160227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.160561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.160900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.170241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 939/1859] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:34.170241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.181472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36087a-5536-41a9-b73f-aa9e90717f0c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.186231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.186861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.186976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:34.187135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.187400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.188111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.188213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.190261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.218882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 940/1860] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:34.218882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.254345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 921/1861] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:34.261148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.273012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a666b-79d0-4b36-8292-c7d35a067cbc None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.283298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b8421-aaaa-4ab3-ab56-8b3c233019f5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.290013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3378182854c74852a1d051b84292e37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74db5b7587404cb59088ba83a6dd243d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.290999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.291286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.291562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] PATH_INFO: `/v3/projects/d305c8d57faf4fd2820515be0e72a42a` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.292768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d305c8d57faf4fd2820515be0e72a42a)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.294755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.336294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.336965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.337262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.337542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.338292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.339897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.350014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd305c8d57faf4fd2820515be0e72a42a', 'request_id': 'req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.352094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 922/1862] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:34.352851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.359711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd305c8d57faf4fd2820515be0e72a42a', 'request_id': 'req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.366797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd305c8d57faf4fd2820515be0e72a42a', 'request_id': 'req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.369323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375feff9-4e1c-4dfe-8068-710cb58e182c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.383584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] The token cache is being invalidate because project d305c8d57faf4fd2820515be0e72a42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:34.383584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.384428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.389887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 941/1863] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:34 2022] DELETE /identity/v3/projects/d305c8d57faf4fd2820515be0e72a42a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:34.390777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.392426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.444718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.445543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.445815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.446136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.446931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.448715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.474174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 923/1864] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:34.475203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.477261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.491536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e6f3-e237-4a3f-8d76-bff391473882 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.493376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b777d96-ea8b-4acc-ae24-dfc4dc476d4f tempest-VolumeQuotaClassesTest-1756953523 tempest-VolumeQuotaClassesTest-1756953523-project-admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.497550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5c52c-ff92-4dc0-bea3-0f1e2b493223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.498777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5c52c-ff92-4dc0-bea3-0f1e2b493223 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.499080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5c52c-ff92-4dc0-bea3-0f1e2b493223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.499400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5c52c-ff92-4dc0-bea3-0f1e2b493223 admin admin] PATH_INFO: `/v3/projects/1814326e337041289cca51c94dd73761/users/ef3a4763a62749b28f68ef20b47beb36/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.500064 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.500771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.500966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.501238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.503108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.515081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5c52c-ff92-4dc0-bea3-0f1e2b493223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1814326e337041289cca51c94dd73761, user_id=ef3a4763a62749b28f68ef20b47beb36, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.515205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.517169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.517684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5c52c-ff92-4dc0-bea3-0f1e2b493223 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.529825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 942/1865] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:34.530792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.532173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.533272 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 924/1866] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:34 2022] PUT /identity/v3/projects/1814326e337041289cca51c94dd73761/users/ef3a4763a62749b28f68ef20b47beb36/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:34.544617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.544911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.545194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.546214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96299b-64e2-4b94-a542-f36ce29c3471 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.574776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] MFA Rules not processed for user `ef3a4763a62749b28f68ef20b47beb36`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:34.576468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.631348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.632881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.632881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.633063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.633799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.635920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.652288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 943/1867] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:34.653035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.654722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.670221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 925/1868] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:34.671349 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.683346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc7b5-d7b9-4eec-8157-bbccf6282739 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.684871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a499d2d-3cfe-4c2d-9103-07f37378139e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.689432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.690357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.690636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.690983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] PATH_INFO: `/v3/users/4c5bb28dde014a1784585db1690afd1b` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.692297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5bb28dde014a1784585db1690afd1b)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.694275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.700508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.702581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.702940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.703315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.704133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.707478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.721203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 926/1869] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:34.723297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.734816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c7616-0345-4b5c-b057-a1ede4257f6c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.741417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.742377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.742865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.743520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.744394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.748168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.756685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5bb28dde014a1784585db1690afd1b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.766572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5bb28dde014a1784585db1690afd1b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.785706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5bb28dde014a1784585db1690afd1b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.786543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5bb28dde014a1784585db1690afd1b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.792090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 927/1870] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/projects => generated 357 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:34.794971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5bb28dde014a1784585db1690afd1b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:34.795966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.798674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.805740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 944/1871] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:34 2022] DELETE /identity/v3/users/4c5bb28dde014a1784585db1690afd1b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:34.806624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.808016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.864465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ffff-9964-4bb9-b7de-0ed6101c8015 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.889260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f962d-147e-4407-b275-f7074064ad6c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.893810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6166-997e-4ff0-9467-a1240fcf577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.894531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6166-997e-4ff0-9467-a1240fcf577f admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.894850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6166-997e-4ff0-9467-a1240fcf577f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.895122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6166-997e-4ff0-9467-a1240fcf577f admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.895808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6166-997e-4ff0-9467-a1240fcf577f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.897741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6166-997e-4ff0-9467-a1240fcf577f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.918809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 945/1872] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:34.920297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.920753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.921258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.926316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:34.927230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:34.927517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:34.927795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] PATH_INFO: `/v3/projects/127cf00a9b164f5cb1291a64dda46023/users/6c2eac1ea1b24f4696aa81204e0bfcc0/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:34.939205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:34.940392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:34.943255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127cf00a9b164f5cb1291a64dda46023, user_id=6c2eac1ea1b24f4696aa81204e0bfcc0, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:34.945947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:34.951341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 946/1873] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:34.951341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.961083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091ac13-f5a2-40f4-a44c-199c1d2f35ad None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:34.962910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 928/1874] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:34 2022] PUT /identity/v3/projects/127cf00a9b164f5cb1291a64dda46023/users/6c2eac1ea1b24f4696aa81204e0bfcc0/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:34.963753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:34.965328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.018691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569061af-d7a2-4fa5-aaea-23e79a602a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.019532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569061af-d7a2-4fa5-aaea-23e79a602a45 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.019807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569061af-d7a2-4fa5-aaea-23e79a602a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.020116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569061af-d7a2-4fa5-aaea-23e79a602a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.021035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569061af-d7a2-4fa5-aaea-23e79a602a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.022200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f90477-1414-44ad-a880-efbd565e2225 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.023118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569061af-d7a2-4fa5-aaea-23e79a602a45 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.026714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.027557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.027999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.028423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.034334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 947/1875] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:35.036719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.036719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.036924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.038753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.040186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.049737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 929/1876] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:35.050555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.059546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb4e9e-22a6-45d3-a28d-37359b88c497 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.063705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] MFA Rules not processed for user `6c2eac1ea1b24f4696aa81204e0bfcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:35.064519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.064807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.065415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.066238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.066846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] PATH_INFO: `/v3/projects/54653a2bf38b4578bd70d977ae23207a/users/731218baa14a4b558af26d8aca909426/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.080901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54653a2bf38b4578bd70d977ae23207a, user_id=731218baa14a4b558af26d8aca909426, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.084038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.098774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 930/1877] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:35 2022] PUT /identity/v3/projects/54653a2bf38b4578bd70d977ae23207a/users/731218baa14a4b558af26d8aca909426/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:35.103135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.136674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 948/1878] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:35.142948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.155539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120862d-e9f2-4e5a-a373-96d8384a1f0d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.168572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d68bf4-4d4d-4437-98c5-a0779fa6d665 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.173522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.174350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.174642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.174929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.176209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.178042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.189015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 931/1879] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:35.194984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.210126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4409fc-e4c7-4ce9-bc4d-22732fe5891e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.216067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abb7ad-388d-4aae-92c1-436e4ee69f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.217161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abb7ad-388d-4aae-92c1-436e4ee69f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.217464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abb7ad-388d-4aae-92c1-436e4ee69f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.217829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abb7ad-388d-4aae-92c1-436e4ee69f44 admin admin] PATH_INFO: `/v3/projects/54653a2bf38b4578bd70d977ae23207a/users/731218baa14a4b558af26d8aca909426/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.219870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abb7ad-388d-4aae-92c1-436e4ee69f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54653a2bf38b4578bd70d977ae23207a, user_id=731218baa14a4b558af26d8aca909426, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.221048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.221724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.222107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.222396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.222905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abb7ad-388d-4aae-92c1-436e4ee69f44 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.223187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.225105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.234811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 932/1880] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:35 2022] PUT /identity/v3/projects/54653a2bf38b4578bd70d977ae23207a/users/731218baa14a4b558af26d8aca909426/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:35.245168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.245489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.245831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.259042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 949/1881] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:35 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:35.263311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.274634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] MFA Rules not processed for user `731218baa14a4b558af26d8aca909426`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:35.275853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.335509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd34b-34d9-46c6-9d4c-a5bb7596a630 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.341193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.341985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.342174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.342451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.343173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.345971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.357647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 933/1882] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:35.358773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.360239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.374947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f01d5f-d249-4df5-81f6-cc6d7f51277c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.379789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.380663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.380948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.381358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] PATH_INFO: `/v3/projects/1855c136aa9c4e5bb1d73cded663835f` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.382583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1855c136aa9c4e5bb1d73cded663835f)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.383638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 950/1883] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:35 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:35.384370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.384552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.386042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.434232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1855c136aa9c4e5bb1d73cded663835f', 'request_id': 'req-65722bdc-8181-4671-9480-d6a518b98b09'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.443050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1855c136aa9c4e5bb1d73cded663835f', 'request_id': 'req-65722bdc-8181-4671-9480-d6a518b98b09'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.446965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45321e-328e-4263-9ad8-8c24d8e99e5a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.448968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1855c136aa9c4e5bb1d73cded663835f', 'request_id': 'req-65722bdc-8181-4671-9480-d6a518b98b09'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.459790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] The token cache is being invalidate because project 1855c136aa9c4e5bb1d73cded663835f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:35.460087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.460752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.462613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 934/1884] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:35 2022] DELETE /identity/v3/projects/1855c136aa9c4e5bb1d73cded663835f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:35.463125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.464433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.509029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.509691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.510028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.510311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.512536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.562777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65722bdc-8181-4671-9480-d6a518b98b09 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.573796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.574521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.576874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.577180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.578026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.580151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.608436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 935/1885] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:35.609175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.609378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.611515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.614411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.632104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4431177-99ca-499e-8168-619a241d6ad4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.635477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 951/1886] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:35.636680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.646451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.647435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.647725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.648003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] PATH_INFO: `/v3/users/3378182854c74852a1d051b84292e37e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.656026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3378182854c74852a1d051b84292e37e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.658241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.661554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fc628-7821-4716-bf76-5891298268ef service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.668395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.676154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.676472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.676700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.677448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.679115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.714105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 952/1887] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:35.715575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.748891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9492b5-276a-4a3e-84d6-9a5a4ba57a32 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:35.762063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3378182854c74852a1d051b84292e37e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.766357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:35.768091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.768384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.768657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] PATH_INFO: `/v3/projects/a3be9c0dfd1444c88601a0c3179b8237/users/1937d0043d444771ad73380a39298bf4/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.779889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3378182854c74852a1d051b84292e37e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.806652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3be9c0dfd1444c88601a0c3179b8237, user_id=1937d0043d444771ad73380a39298bf4, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:35.808267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3378182854c74852a1d051b84292e37e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.810208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3378182854c74852a1d051b84292e37e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.810644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:35.812271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-292216be-0f0f-4745-8143-38e8b09e1d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3378182854c74852a1d051b84292e37e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:35.834946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 953/1888] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:35 2022] PUT /identity/v3/projects/a3be9c0dfd1444c88601a0c3179b8237/users/1937d0043d444771ad73380a39298bf4/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:35.845071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:35.848445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.854580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 936/1889] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:35 2022] DELETE /identity/v3/users/3378182854c74852a1d051b84292e37e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:35.856347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47ded-53b6-43ef-ba71-a741d31a47a6 None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.857600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47ded-53b6-43ef-ba71-a741d31a47a6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.858118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47ded-53b6-43ef-ba71-a741d31a47a6 None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.868300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 937/1890] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:51:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:51:35.870896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ff7a1-5b8c-4bb3-b7ca-a4d02d98a4cb None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:35.871192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ff7a1-5b8c-4bb3-b7ca-a4d02d98a4cb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:35.871478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ff7a1-5b8c-4bb3-b7ca-a4d02d98a4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:35.930708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9a5ff7a1-5b8c-4bb3-b7ca-a4d02d98a4cb None None] MFA Rules not processed for user `1937d0043d444771ad73380a39298bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:35.932099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9a5ff7a1-5b8c-4bb3-b7ca-a4d02d98a4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:35.951980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938f08-cb93-4f59-b257-0f8ca20af8e3 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.026943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 938/1891] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:36.028680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.028992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.029286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.053395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:36.054685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:36.089575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.090272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.090553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.090823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.095327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:36.154005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 939/1892] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:36.157008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.163989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:36.262140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.263528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.282478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 954/1893] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:36.333213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084ea28-67e1-4fe4-87c2-42b6048261c7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.340035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.341180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.341709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.342243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.343357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.359827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.388399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.391551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:36.443341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 940/1894] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:36 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:36.444435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.449146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555834b0-bf36-4634-911f-b4a9ec7caed5 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.566384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ac4ea-9e01-4644-baa9-5be065607721 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.568981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.569711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.570163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.570459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.573174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.574247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.574727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.575180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.577262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.580310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.580730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.583413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.601962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 955/1895] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:36.614235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 941/1896] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:36 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:36.615162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.627657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a5e6-7db2-4b52-b03a-f4539f7a9b83 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.633511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.634349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.634745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.635120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.636359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.638206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.654178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 956/1897] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:36.658726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.671085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9a67-17b3-4900-8d83-898dee1cf518 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.689624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.691030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.691631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.691921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] PATH_INFO: `/v3/projects/2030d8e49626400daac102eb423335b9/users/e68d1a482b4547ad9f1b1b61c4e20d32/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.711382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2030d8e49626400daac102eb423335b9, user_id=e68d1a482b4547ad9f1b1b61c4e20d32, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.713705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.742845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 942/1898] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:36 2022] PUT /identity/v3/projects/2030d8e49626400daac102eb423335b9/users/e68d1a482b4547ad9f1b1b61c4e20d32/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:36.746846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.760985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bcdb1-2fdf-4e07-9c26-f12ef609ace1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.857936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27e4ce-a7bc-4191-9603-1107cf370996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.858882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e4ce-a7bc-4191-9603-1107cf370996 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.859221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e4ce-a7bc-4191-9603-1107cf370996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.859547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e4ce-a7bc-4191-9603-1107cf370996 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.860417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27e4ce-a7bc-4191-9603-1107cf370996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.863171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27e4ce-a7bc-4191-9603-1107cf370996 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.885587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 957/1899] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:36.889369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:36.903330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1bb44-7552-4623-90a2-a1daf940cdf5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:36.908861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:36.910865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.911586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.911978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] PATH_INFO: `/v3/projects/2030d8e49626400daac102eb423335b9/users/e68d1a482b4547ad9f1b1b61c4e20d32/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.914235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2030d8e49626400daac102eb423335b9, user_id=e68d1a482b4547ad9f1b1b61c4e20d32, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:36.919171 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:36.940331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 943/1900] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:36 2022] PUT /identity/v3/projects/2030d8e49626400daac102eb423335b9/users/e68d1a482b4547ad9f1b1b61c4e20d32/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:36.948835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:36.948835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:36.948835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:36.985023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] MFA Rules not processed for user `e68d1a482b4547ad9f1b1b61c4e20d32`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:36.986273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:37.098917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 958/1901] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:37.107406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:37.223467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddf883-7990-44fc-81ac-1d3916df9fc9 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:37.228551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:37.229314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:37.229696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:37.230112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:37.254448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:37.256129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:37.277908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 944/1902] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:37.324741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:37.338040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271a903-1df5-4872-92b9-e4b8dda85b10 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:37.343683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:37.345630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:37.346296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:37.347744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:37.369014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:37.479441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:37.482356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dcf31-5f53-41ad-aa1e-81c15383f6a2 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:37.493942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 959/1903] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:37.709793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:37.713989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:37.838789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4060ec-91da-4112-b4a4-6d71e58e0e64 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:37.844667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:37.845785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:37.846106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:37.847410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] PATH_INFO: `/v3/projects/74db5b7587404cb59088ba83a6dd243d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:37.848463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74db5b7587404cb59088ba83a6dd243d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:37.850451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:37.906265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74db5b7587404cb59088ba83a6dd243d', 'request_id': 'req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:37.926287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74db5b7587404cb59088ba83a6dd243d', 'request_id': 'req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:37.952473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74db5b7587404cb59088ba83a6dd243d', 'request_id': 'req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:37.973561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] The token cache is being invalidate because project 74db5b7587404cb59088ba83a6dd243d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:37.973995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:37.975123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d33afe4-3ac5-4dd8-b56f-c00c125bae5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:37.979800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 945/1904] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:37 2022] DELETE /identity/v3/projects/74db5b7587404cb59088ba83a6dd243d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:37.984145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:37.984437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:37.984713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.006074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:38.008161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:38.090022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 960/1905] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:38.096212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.096487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.097313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.117358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:38.118621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:38.127991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 946/1906] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:38.132610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.145801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb330142-66c3-418c-822c-ff4a74164390 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.151102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.151857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.153470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.153470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.153470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:38.162387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.164414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.184648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 961/1907] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:38.187119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.201159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ae1d0-4604-4d18-8127-20b4565a9bff None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.206718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.207792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.208143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.208536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.209551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.211569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.243203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 947/1908] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:38 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:38.248869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.264272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36a8fa-0a91-4c5f-84f3-d41e3540db4d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.350850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.351421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.352292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.352804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.353532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.355633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.380717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 962/1909] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:38 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:38.383132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.393015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabab02-685f-4e6e-b3ee-8ab47be70334 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.398142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.398814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.399223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.399552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.400279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.401882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.417932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 948/1910] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:38.419450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.434595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbfef-21f9-4cf7-8b7f-2c8a8b8260cc admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.439536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad469a4-d399-42c9-8388-73a353bb34a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.440223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad469a4-d399-42c9-8388-73a353bb34a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.440500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad469a4-d399-42c9-8388-73a353bb34a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.440922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad469a4-d399-42c9-8388-73a353bb34a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.441720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad469a4-d399-42c9-8388-73a353bb34a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.443454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad469a4-d399-42c9-8388-73a353bb34a8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.465890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 963/1911] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:38.468112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.481040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926a9d-9ee8-4245-98ab-a554117656a3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.487066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.490025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.490025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.490025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] PATH_INFO: `/v3/projects/ba58d89e2a3340dab14243387f3b8c33/users/6b23328bab0d40a2831b88cbed8478c7/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.505098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba58d89e2a3340dab14243387f3b8c33, user_id=6b23328bab0d40a2831b88cbed8478c7, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.507917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.531600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 949/1912] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:38 2022] PUT /identity/v3/projects/ba58d89e2a3340dab14243387f3b8c33/users/6b23328bab0d40a2831b88cbed8478c7/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:38.551550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.551894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.552801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.606695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] MFA Rules not processed for user `6b23328bab0d40a2831b88cbed8478c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:38.607961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:38.691425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 964/1913] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:38.695809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.807607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c66c0c-78b3-4d86-8565-3bd0339b66cf admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:38.817173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:38.817919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:38.818209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:38.818486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:38.819312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:38.821223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:38.874702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 950/1914] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:38 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:38.878958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:38.893544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a96a-f6e3-4ad4-9bab-c40d546f12b2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:39.024606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:39.027503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.028833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.029355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.031135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:39.036964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:39.093338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 965/1915] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:38 2022] POST /identity/v3/users => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:39.098829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:39.111815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c3e44-82a3-4ca4-8a84-b7dd1d5fda28 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:39.121565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:39.122666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.127305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.127602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.128477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:39.135007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:39.149556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 951/1916] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:39.153564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:39.171215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d167e-800a-4055-9b9e-3ddf981e7d15 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:39.189553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:39.190703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.191054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.191331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] PATH_INFO: `/v3/projects/3e179db9416c4cbea39f3c74bb50b266/users/e04b848d89fc4ea3a33bd37fdebe62fe/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.225268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e179db9416c4cbea39f3c74bb50b266, user_id=e04b848d89fc4ea3a33bd37fdebe62fe, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:39.231695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:39.262837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 966/1917] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:39 2022] PUT /identity/v3/projects/3e179db9416c4cbea39f3c74bb50b266/users/e04b848d89fc4ea3a33bd37fdebe62fe/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:39.266842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:39.283880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d39a7c-d49c-40c9-b2fd-25d6506feaa6 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:39.449657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87d7c-9d30-4d3c-94c5-dd31ffe01064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:39.451095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87d7c-9d30-4d3c-94c5-dd31ffe01064 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.453933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87d7c-9d30-4d3c-94c5-dd31ffe01064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.454735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87d7c-9d30-4d3c-94c5-dd31ffe01064 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.463021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87d7c-9d30-4d3c-94c5-dd31ffe01064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:39.465787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87d7c-9d30-4d3c-94c5-dd31ffe01064 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:39.504233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 952/1918] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:39.509574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:39.527098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e116acb-8e90-477c-81db-36de666eb9cd admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:39.533438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:39.534451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.534731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.535334 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] PATH_INFO: `/v3/projects/3e179db9416c4cbea39f3c74bb50b266/users/e04b848d89fc4ea3a33bd37fdebe62fe/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.537471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e179db9416c4cbea39f3c74bb50b266, user_id=e04b848d89fc4ea3a33bd37fdebe62fe, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:39.541906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:39.558745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 967/1919] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:39 2022] PUT /identity/v3/projects/3e179db9416c4cbea39f3c74bb50b266/users/e04b848d89fc4ea3a33bd37fdebe62fe/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:39.572766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.573055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.577615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.631597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] MFA Rules not processed for user `e04b848d89fc4ea3a33bd37fdebe62fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:39.632820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:39.752387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 953/1920] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:39.801515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:39.804619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:39.888303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024e316-2936-4740-a591-14f5478327a9 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:39.892663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:39.893493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:39.893841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:39.894347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:39.907322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:39.909966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:39.917968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:39.919386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:39.930070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 968/1921] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:40.040983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835de44-eb41-4c2e-8da2-d4cfa0791aab None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:40.047320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:40.048277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:40.048625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:40.048962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] PATH_INFO: `/v3/users/5a8d4554b12143b18119bc15bf1e48da` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:40.050861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8d4554b12143b18119bc15bf1e48da)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:40.056453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:40.083911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:40.095400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939111bf-723a-4ea7-bdf7-6b3df308f977 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:40.120831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:40.122776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:40.123285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:40.125323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] PATH_INFO: `/v3/users/6b23328bab0d40a2831b88cbed8478c7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:40.126652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8d4554b12143b18119bc15bf1e48da'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.127092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b23328bab0d40a2831b88cbed8478c7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:40.129670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:40.137586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8d4554b12143b18119bc15bf1e48da'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.153517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8d4554b12143b18119bc15bf1e48da'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.154704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8d4554b12143b18119bc15bf1e48da'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.155621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-87ff44f5-59f3-44fc-be33-b776a88e303e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8d4554b12143b18119bc15bf1e48da'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.195215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 954/1922] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:39 2022] DELETE /identity/v3/users/5a8d4554b12143b18119bc15bf1e48da => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:40.199858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:40.200374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:40.201029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:40.237528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:40.239161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:40.242682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b23328bab0d40a2831b88cbed8478c7'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.262216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b23328bab0d40a2831b88cbed8478c7'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.277847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b23328bab0d40a2831b88cbed8478c7'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.278631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b23328bab0d40a2831b88cbed8478c7'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.288208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-f8038122-cb8e-4362-b589-90ca7bc3a2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b23328bab0d40a2831b88cbed8478c7'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:40.295796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 969/1923] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:40 2022] DELETE /identity/v3/users/6b23328bab0d40a2831b88cbed8478c7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:40.300055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:40.300213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:40.300628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:40.330330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:40.332293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:40.415308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 955/1924] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:40.441302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:40.442754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:40.467300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 970/1925] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:40.526169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:40.528923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:40.537404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1630d18-6e3a-4388-8d48-b495227fc90f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:40.638030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:40.640313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:40.642509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:40.643019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:40.669058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:40.671452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:40.673181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dfb90-7407-48e3-bbcc-b78289d34c9b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:40.682328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbedd36-1ef2-40d4-b403-5f7be86177a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:40.683385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbedd36-1ef2-40d4-b403-5f7be86177a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:40.683872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbedd36-1ef2-40d4-b403-5f7be86177a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:40.684618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbedd36-1ef2-40d4-b403-5f7be86177a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:40.701983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 956/1926] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:40.710670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbedd36-1ef2-40d4-b403-5f7be86177a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:40.710670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbedd36-1ef2-40d4-b403-5f7be86177a4 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:40.756923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 971/1927] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:40.967759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:40.970742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:41.019715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f45702-923a-45d1-aaab-202acb936905 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:41.028124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:41.029538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:41.030097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:41.030546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] PATH_INFO: `/v3/users/6c2eac1ea1b24f4696aa81204e0bfcc0` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:41.036008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2eac1ea1b24f4696aa81204e0bfcc0)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:41.040435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:41.143115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2eac1ea1b24f4696aa81204e0bfcc0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.164973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2eac1ea1b24f4696aa81204e0bfcc0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.196912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2eac1ea1b24f4696aa81204e0bfcc0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.198224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2eac1ea1b24f4696aa81204e0bfcc0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.199748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2eac1ea1b24f4696aa81204e0bfcc0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.225179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 957/1928] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:40 2022] DELETE /identity/v3/users/6c2eac1ea1b24f4696aa81204e0bfcc0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:41.240689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:41.241277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:41.244472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:41.265417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:41.267027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:41.306454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:41.308601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:41.383641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 972/1929] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:41.396628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:41.398517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:41.505212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de6f4-f373-4b27-8a85-7c8e4ca9aabe admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:41.535099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:41.535995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:41.536280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:41.536552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] PATH_INFO: `/v3/projects/85f99487b1e649de952b335d1fb065d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:41.543624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d2de7-8273-45ff-8ef9-49718b43bd20 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:41.544687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f99487b1e649de952b335d1fb065d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:41.548099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:41.548752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:41.549029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:41.549302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:41.554346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:41.574887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:41.583196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:41.615015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 973/1930] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:41.702215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f99487b1e649de952b335d1fb065d7', 'request_id': 'req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.724360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f99487b1e649de952b335d1fb065d7', 'request_id': 'req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.742181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f99487b1e649de952b335d1fb065d7', 'request_id': 'req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.783031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] The token cache is being invalidate because project 85f99487b1e649de952b335d1fb065d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:41.783331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.784030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:41.786715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 958/1931] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:41 2022] DELETE /identity/v3/projects/85f99487b1e649de952b335d1fb065d7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:41.790527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:41.813696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9dd2a-6973-4e3b-b7a4-d8bb701e2c24 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:41.953722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:41.954792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:41.955170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:41.955544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] PATH_INFO: `/v3/users/8ccad48cb81c4d0ca76d1b20a0857756` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:41.957216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccad48cb81c4d0ca76d1b20a0857756)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:41.959379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:42.029366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccad48cb81c4d0ca76d1b20a0857756'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.043822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccad48cb81c4d0ca76d1b20a0857756'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.068399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccad48cb81c4d0ca76d1b20a0857756'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.069390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccad48cb81c4d0ca76d1b20a0857756'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.080744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccad48cb81c4d0ca76d1b20a0857756'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.088587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 974/1932] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:41 2022] DELETE /identity/v3/users/8ccad48cb81c4d0ca76d1b20a0857756 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:42.331264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:42.332767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:42.353368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab4f3a-3866-4ae1-b07a-a3d4f4ed628a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:42.419350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:42.420659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:42.421102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:42.421470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] PATH_INFO: `/v3/projects/ba58d89e2a3340dab14243387f3b8c33` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:42.423346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba58d89e2a3340dab14243387f3b8c33)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:42.438815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:42.499864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba58d89e2a3340dab14243387f3b8c33', 'request_id': 'req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.510328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba58d89e2a3340dab14243387f3b8c33', 'request_id': 'req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.518527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba58d89e2a3340dab14243387f3b8c33', 'request_id': 'req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.529775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] The token cache is being invalidate because project ba58d89e2a3340dab14243387f3b8c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:42.530257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.531686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.533039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 959/1933] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:42 2022] DELETE /identity/v3/projects/ba58d89e2a3340dab14243387f3b8c33 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:42.538018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:42.539572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:42.553519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bb53d-4c57-4ab4-ae5f-77e85da38dfc admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:42.621775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:42.623357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:42.623871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:42.624362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] PATH_INFO: `/v3/users/e04b848d89fc4ea3a33bd37fdebe62fe` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:42.625890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04b848d89fc4ea3a33bd37fdebe62fe)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:42.628740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:42.702097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:42.704875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:42.733021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04b848d89fc4ea3a33bd37fdebe62fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.743087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04b848d89fc4ea3a33bd37fdebe62fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.746926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fdeeb-55ed-4e3d-9220-45fc5c4a94b7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:42.754892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:42.756225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:42.757335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:42.758402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] PATH_INFO: `/v3/projects/127cf00a9b164f5cb1291a64dda46023` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:42.760465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04b848d89fc4ea3a33bd37fdebe62fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.761030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127cf00a9b164f5cb1291a64dda46023)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:42.762459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04b848d89fc4ea3a33bd37fdebe62fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.764875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:42.775954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04b848d89fc4ea3a33bd37fdebe62fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.794347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 975/1934] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:42 2022] DELETE /identity/v3/users/e04b848d89fc4ea3a33bd37fdebe62fe => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:42.795253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:42.801907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:42.874433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127cf00a9b164f5cb1291a64dda46023', 'request_id': 'req-066ee703-e58c-45ea-a156-d2b532a42c56'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.895271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127cf00a9b164f5cb1291a64dda46023', 'request_id': 'req-066ee703-e58c-45ea-a156-d2b532a42c56'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.904585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127cf00a9b164f5cb1291a64dda46023', 'request_id': 'req-066ee703-e58c-45ea-a156-d2b532a42c56'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.933213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] The token cache is being invalidate because project 127cf00a9b164f5cb1291a64dda46023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:42.933338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bcab9-a2be-4222-9a8b-2b30d2dcf148 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:42.933691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.935828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:42.939526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 960/1935] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:42 2022] DELETE /identity/v3/projects/127cf00a9b164f5cb1291a64dda46023 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:42.955144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:42.962730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:43.011121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:43.012210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.012715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.013087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] PATH_INFO: `/v3/projects/8b673d6b75e645dcab7f40bc6a452452` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.015002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b673d6b75e645dcab7f40bc6a452452)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:43.017266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:43.141578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b673d6b75e645dcab7f40bc6a452452', 'request_id': 'req-1cf24778-ea24-43f6-99d3-a82e6bf70986'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.161785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b673d6b75e645dcab7f40bc6a452452', 'request_id': 'req-1cf24778-ea24-43f6-99d3-a82e6bf70986'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.165119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee703-e58c-45ea-a156-d2b532a42c56 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:43.170864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b673d6b75e645dcab7f40bc6a452452', 'request_id': 'req-1cf24778-ea24-43f6-99d3-a82e6bf70986'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.205630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] The token cache is being invalidate because project 8b673d6b75e645dcab7f40bc6a452452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:43.207303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.208686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1cf24778-ea24-43f6-99d3-a82e6bf70986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.212034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 976/1936] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:42 2022] DELETE /identity/v3/projects/8b673d6b75e645dcab7f40bc6a452452 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:43.218658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.220602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.224650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.297106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:43.298907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:43.379217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:43.380199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.381188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.381466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] PATH_INFO: `/v3/users/1937d0043d444771ad73380a39298bf4` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.385996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1937d0043d444771ad73380a39298bf4)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:43.388342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:43.455920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1937d0043d444771ad73380a39298bf4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.467799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1937d0043d444771ad73380a39298bf4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.486406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1937d0043d444771ad73380a39298bf4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.487803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1937d0043d444771ad73380a39298bf4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.488639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ac0bca48-becf-4dee-962e-6258679be0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1937d0043d444771ad73380a39298bf4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.515332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 977/1937] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:43.521357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 961/1938] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:42 2022] DELETE /identity/v3/users/1937d0043d444771ad73380a39298bf4 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:43.521357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.521357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.521357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.539011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:43.540707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:43.541678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:43.543111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:43.594871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56514fb-8fb8-4aac-a223-717892089c75 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:43.641676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 962/1939] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:43.647238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:43.666123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7e19f-8229-4690-9e1b-b2869238a122 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:43.677894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:43.678965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.679905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.680980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.682475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:43.683857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:43.687047 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:43.719287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 963/1940] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:43.722428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:43.752137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:43.754259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.754829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.755399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] PATH_INFO: `/v3/projects/3e179db9416c4cbea39f3c74bb50b266` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.756594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc7cee-b915-4c0c-8ef4-132ddf96a430 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:43.757529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e179db9416c4cbea39f3c74bb50b266)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:43.759789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:43.767263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:43.768102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.769340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.769340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.770427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:43.772805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:43.818089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 964/1941] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:43 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:43.821529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:43.872545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e179db9416c4cbea39f3c74bb50b266', 'request_id': 'req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.888594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e179db9416c4cbea39f3c74bb50b266', 'request_id': 'req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.905584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e179db9416c4cbea39f3c74bb50b266', 'request_id': 'req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.917239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] The token cache is being invalidate because project 3e179db9416c4cbea39f3c74bb50b266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:43.917506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.921978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f0a2f09-f295-4ec0-aef6-4d747180b0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:43.923887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 978/1942] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:43 2022] DELETE /identity/v3/projects/3e179db9416c4cbea39f3c74bb50b266 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:43.929319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fa519-0226-4cfb-a81d-d46ed130050a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:43.929704 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fa519-0226-4cfb-a81d-d46ed130050a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:43.930161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fa519-0226-4cfb-a81d-d46ed130050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:43.971543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b09fa519-0226-4cfb-a81d-d46ed130050a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:43.974487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c7ff1-ba2f-4a9a-a9ab-b08d7d42c46c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:43.975424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b09fa519-0226-4cfb-a81d-d46ed130050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.063535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 979/1943] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:44.069640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.070663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.072140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.072428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.072853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.074403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.074731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.075449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.077557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.104770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:44.106014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.122708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 965/1944] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:43 2022] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:44.126581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.128418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.132786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 980/1945] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:44.137943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.150325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6f86-6f87-4e56-934f-05b685173c9d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.153501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04dd17-6def-49e5-b620-3c0d2a8f18d1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.163149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.164217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.164887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.166042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.166184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.170003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.170472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.171041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.172637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.173276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:44.173684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.175942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.178018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.212344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 981/1946] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:44.213400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.216785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.222059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 966/1947] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:44.222059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.240247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acf3f-38bb-4623-89e9-f67a7d6ef61c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.245928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.247089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.247377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.247651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] PATH_INFO: `/v3/projects/a3be9c0dfd1444c88601a0c3179b8237` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.248852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3be9c0dfd1444c88601a0c3179b8237)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.251070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.254612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eaf91-ce90-4b62-b41f-dd26f6feefdb admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.260490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.261614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.262496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.262794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.264159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.267874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.299029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 967/1948] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:44 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:44.303156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.305181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3be9c0dfd1444c88601a0c3179b8237', 'request_id': 'req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.313230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3be9c0dfd1444c88601a0c3179b8237', 'request_id': 'req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.320922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3be9c0dfd1444c88601a0c3179b8237', 'request_id': 'req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.333280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] The token cache is being invalidate because project a3be9c0dfd1444c88601a0c3179b8237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:44.333580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.334268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.336026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 982/1949] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:44 2022] DELETE /identity/v3/projects/a3be9c0dfd1444c88601a0c3179b8237 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:44.336810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.338222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.375080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810a26-33a9-4226-aa79-2475b3bb34d6 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.380134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.380811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.381090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.381364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.382470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.384542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.396193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 968/1950] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:44.397453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.400720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.407921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3c3f-5f28-4943-81d4-bdba6ce4cc5c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.416001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.416954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.417432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.417654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.418004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb780-bd4c-4cfa-a815-888e8ae76cb1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.419685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.422290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.426964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.427933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.428288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.428735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] PATH_INFO: `/v3/users/e68d1a482b4547ad9f1b1b61c4e20d32` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.430351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68d1a482b4547ad9f1b1b61c4e20d32)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.433494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.448219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 983/1951] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:44 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:44.449353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.456586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.470034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2ab17-4de1-43ff-afe1-5e3b7cb40e23 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.477363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.478365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.478736 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.478904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] PATH_INFO: `/v3/projects/6a6a4e00524142248305a2a19222054b/users/1cd783f6321d4618b3a92e2d6d619e92/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.500165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6a4e00524142248305a2a19222054b, user_id=1cd783f6321d4618b3a92e2d6d619e92, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.503733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.507900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68d1a482b4547ad9f1b1b61c4e20d32'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.530273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 984/1952] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:44 2022] PUT /identity/v3/projects/6a6a4e00524142248305a2a19222054b/users/1cd783f6321d4618b3a92e2d6d619e92/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:44.530273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.531687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68d1a482b4547ad9f1b1b61c4e20d32'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.553051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68d1a482b4547ad9f1b1b61c4e20d32'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.554271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68d1a482b4547ad9f1b1b61c4e20d32'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.555053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aeb3830c-058d-41d8-a839-56807d409d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68d1a482b4547ad9f1b1b61c4e20d32'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:44.573372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 969/1953] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:44 2022] DELETE /identity/v3/users/e68d1a482b4547ad9f1b1b61c4e20d32 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:44.575151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.575584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.576077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.619707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] MFA Rules not processed for user `1cd783f6321d4618b3a92e2d6d619e92`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:44.621085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.655593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78732-0d85-441e-9169-64ebdf1d0750 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.727213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 970/1954] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:44.739320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.741647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.751225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.753730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.754082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.754481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.755155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.757189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.785248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 985/1955] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:44.789608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.798717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:44.831453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96050-4245-478c-94ab-fa839a8f751e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.839896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1749c8-d86a-4410-9b03-7e05b21da993 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.845018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.845652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d50f65-a58a-4b40-82ef-bb3ad775269a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.846345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d50f65-a58a-4b40-82ef-bb3ad775269a service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.847528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d50f65-a58a-4b40-82ef-bb3ad775269a service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.848282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d50f65-a58a-4b40-82ef-bb3ad775269a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.854406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.854741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.855028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.855801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.857661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.860657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d50f65-a58a-4b40-82ef-bb3ad775269a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.864941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d50f65-a58a-4b40-82ef-bb3ad775269a service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.874923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 986/1956] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:44.875535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 971/1957] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:44.876825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:44.902465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4b19-a2f9-4196-a20c-b635f5a520b3 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:44.908781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:44.910285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.910915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.911219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] PATH_INFO: `/v3/projects/35aab1aa5dcc4e889adfaf0c4b1a5636/users/61ae0b2bda294ff683adbffe0a2680ba/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:44.941601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35aab1aa5dcc4e889adfaf0c4b1a5636, user_id=61ae0b2bda294ff683adbffe0a2680ba, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:44.949880 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:44.991082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 987/1958] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:44 2022] PUT /identity/v3/projects/35aab1aa5dcc4e889adfaf0c4b1a5636/users/61ae0b2bda294ff683adbffe0a2680ba/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:44.991682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:44.991977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:44.992433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.061485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] MFA Rules not processed for user `61ae0b2bda294ff683adbffe0a2680ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:45.061485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:45.152260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:45.155146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:45.175587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 972/1959] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:45.184278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:45.327176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e116a-b219-4442-9c05-83ec5eccd509 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:45.334332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:45.335139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.335563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.335938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.336900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:45.338973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:45.339692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c0b56-fcf6-4e42-8067-f747e0a6ba2d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:45.354684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:45.355913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.356241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.356518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] PATH_INFO: `/v3/projects/2030d8e49626400daac102eb423335b9` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.358713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2030d8e49626400daac102eb423335b9)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:45.370198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:45.444824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 973/1960] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:45 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:45.448361 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:45.522894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2030d8e49626400daac102eb423335b9', 'request_id': 'req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:45.543809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2030d8e49626400daac102eb423335b9', 'request_id': 'req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:45.573946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2030d8e49626400daac102eb423335b9', 'request_id': 'req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:45.605082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] The token cache is being invalidate because project 2030d8e49626400daac102eb423335b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:45.605082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:45.607433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4ca8b0d4-7a2b-49e9-b2b0-3208c12d9b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:45.612102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 988/1961] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:45 2022] DELETE /identity/v3/projects/2030d8e49626400daac102eb423335b9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:45.618966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f7d-21b9-46f2-89bc-bca958a5dcba None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.619310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f7d-21b9-46f2-89bc-bca958a5dcba None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.619764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f7d-21b9-46f2-89bc-bca958a5dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.649081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5e5e-dbd1-4330-bf1c-a6a2d1aa77d6 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:45.682026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-23399f7d-21b9-46f2-89bc-bca958a5dcba None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:45.684071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-23399f7d-21b9-46f2-89bc-bca958a5dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:45.757012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:45.757012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.757012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.757012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.757961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:45.760071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:45.790311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 974/1962] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:45 2022] POST /identity/v3/users => generated 297 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:45.795896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:45.798238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:45.821057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50f78c-80dc-4108-8d49-d8b6c701a2de admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:45.834262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903092-833e-4857-af1f-c80973755392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:45.837619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903092-833e-4857-af1f-c80973755392 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.838413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903092-833e-4857-af1f-c80973755392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.839730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903092-833e-4857-af1f-c80973755392 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.840510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59903092-833e-4857-af1f-c80973755392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:45.849548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59903092-833e-4857-af1f-c80973755392 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:45.869648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 989/1963] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:45.870306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 975/1964] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:45.881414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.882210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.882323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.884611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903092-833e-4857-af1f-c80973755392 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:45.896713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903092-833e-4857-af1f-c80973755392 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:45.912388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:45.914198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.914781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.915307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] PATH_INFO: `/v3/projects/8d61009d534b4d6e93dafa3afcbccce3/users/de0a4d6ff8144daa9ce0587ac4aaf62c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.917982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:45.919524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:45.929027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 990/1965] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:45.933006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:45.949698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d61009d534b4d6e93dafa3afcbccce3, user_id=de0a4d6ff8144daa9ce0587ac4aaf62c, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:45.950460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023be209-3e44-4efb-a668-f566fd432d01 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:45.959236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:45.965591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:45.966405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:45.966714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:45.968623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:45.969619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:45.969968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:45.975237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:45.980787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 976/1966] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:45 2022] PUT /identity/v3/projects/8d61009d534b4d6e93dafa3afcbccce3/users/de0a4d6ff8144daa9ce0587ac4aaf62c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:45.985216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.005528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 991/1967] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:46.010920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.026059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978f3e-9028-4b28-bead-52d837ef5c0c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.096586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1571-72fc-4436-80ed-e5ef8dcb2ff1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.103736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.104419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.104744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.105236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.105890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.107664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.119720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 977/1968] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:46.122608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a802f8-d013-478a-a172-ad8c6b1e0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.123270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a802f8-d013-478a-a172-ad8c6b1e0654 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.123550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a802f8-d013-478a-a172-ad8c6b1e0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.123652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.123822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a802f8-d013-478a-a172-ad8c6b1e0654 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.124607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a802f8-d013-478a-a172-ad8c6b1e0654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.126562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a802f8-d013-478a-a172-ad8c6b1e0654 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.135084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13b65-ed70-402e-876f-3ccc4b8d606b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.142101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.144174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.144553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.144771 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] PATH_INFO: `/v3/projects/8d61009d534b4d6e93dafa3afcbccce3/users/de0a4d6ff8144daa9ce0587ac4aaf62c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.147523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d61009d534b4d6e93dafa3afcbccce3, user_id=de0a4d6ff8144daa9ce0587ac4aaf62c, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.150485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.161317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 978/1969] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:46 2022] PUT /identity/v3/projects/8d61009d534b4d6e93dafa3afcbccce3/users/de0a4d6ff8144daa9ce0587ac4aaf62c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:46.169958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 992/1970] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:46 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:46.170874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.172546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.173038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.173542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.209993 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] MFA Rules not processed for user `de0a4d6ff8144daa9ce0587ac4aaf62c`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:46.211208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:46.245452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b503-73ae-4d39-9e4b-66813cafd4b5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.278154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 993/1971] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:46.289461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.290884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:46.307842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.308522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.308804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.309084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.310107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.311713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.332307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 979/1972] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:46 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:46.336749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.346027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b4891-bc6b-426c-9236-5dd0c15d1a94 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.346285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88793fc5-511c-4490-bb2f-0db6f727fdca None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.350577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.351224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.351320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.351501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.351885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.352061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.352345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.352617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.353338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.354937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.360745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.362924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.365719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 980/1973] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:46.369655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.375644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 994/1974] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:46.379589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fb120-db92-4b1f-a5c4-6ff329be2fed admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.384202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbd12b-202b-4bc7-940a-eb9690ca5e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.384855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbd12b-202b-4bc7-940a-eb9690ca5e06 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.385138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbd12b-202b-4bc7-940a-eb9690ca5e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.385416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbd12b-202b-4bc7-940a-eb9690ca5e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.386180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbd12b-202b-4bc7-940a-eb9690ca5e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.387752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbd12b-202b-4bc7-940a-eb9690ca5e06 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.399029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 981/1975] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:46.403527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.414966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def13f6-64f2-4ed0-aa7d-f7d7e3f1d50b service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.419654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.420543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.420823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.421099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] PATH_INFO: `/v3/projects/959f57c3e9a4418f91406720022e2186/users/93eec5f7fcf745ea91a643cbbe7bbd4b/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.436877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] RBAC: Authorizing `identity:create_grant(project_id=959f57c3e9a4418f91406720022e2186, user_id=93eec5f7fcf745ea91a643cbbe7bbd4b, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.440194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.455429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 995/1976] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:46 2022] PUT /identity/v3/projects/959f57c3e9a4418f91406720022e2186/users/93eec5f7fcf745ea91a643cbbe7bbd4b/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:46.469176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.469656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.469882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.497804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] MFA Rules not processed for user `93eec5f7fcf745ea91a643cbbe7bbd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:46.499124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:46.573354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 982/1977] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:46.587224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.721364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf83dc-db17-429c-8b04-e6f8ea05beba admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.733727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.734726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.735224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.735711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.736649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.743732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.802029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 996/1978] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:46 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:46.804382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.823489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d576d81-2029-4f09-9238-21cc5c10ddcd None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.906924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.907605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.907888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.908326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.908840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.911655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.938006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 983/1979] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:46 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:46.942781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:46.954507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7909e9-b62d-497f-ba56-ea900669a065 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:46.959845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:46.960524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:46.960801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:46.961241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:46.962002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:46.963935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:46.986741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 997/1980] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:46.991306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.008757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdbc49-b881-41c2-a38e-6b3a4aa57cc1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:47.016366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.018799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:47.019780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.020069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.020401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] PATH_INFO: `/v3/projects/1fa495a14f8145bcb8bb9bbadf3f8596/users/ed9aed6f605f4c54bb2c979e04c9a34e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.040857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d483b-02ab-42d4-ac5b-531e0b01ae46 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:47.045945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa495a14f8145bcb8bb9bbadf3f8596, user_id=ed9aed6f605f4c54bb2c979e04c9a34e, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:47.049151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:47.053467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:47.055009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.055213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.055548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] PATH_INFO: `/v3/users/61ae0b2bda294ff683adbffe0a2680ba` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.057239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ae0b2bda294ff683adbffe0a2680ba)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:47.059674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:47.076056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 984/1981] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:46 2022] PUT /identity/v3/projects/1fa495a14f8145bcb8bb9bbadf3f8596/users/ed9aed6f605f4c54bb2c979e04c9a34e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:47.081748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.130809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ae0b2bda294ff683adbffe0a2680ba'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:47.139593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ae0b2bda294ff683adbffe0a2680ba'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:47.171053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ae0b2bda294ff683adbffe0a2680ba'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:47.172037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ae0b2bda294ff683adbffe0a2680ba'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:47.187729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-983a4e43-1959-46c7-92fd-d2c79b76e297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ae0b2bda294ff683adbffe0a2680ba'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:47.201911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 998/1982] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:47 2022] DELETE /identity/v3/users/61ae0b2bda294ff683adbffe0a2680ba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:47.203330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.205017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.206739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.230296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:47.240459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae56b9-9490-428b-995b-bc4c3482e0d7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:47.248814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:47.382378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:47.382578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 999/1983] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:47.382694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.382694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.382694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.390908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.391088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:47.392536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:47.392651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:47.419115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 985/1984] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:47.429386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.433346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:47.501688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a4c92-f0fd-4a43-bf2f-9789cb631f15 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:47.509343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c61f-b290-4046-a9de-d9a9314dd36a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:47.513393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d2ba-54d1-4565-927f-267e2d64319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:47.514342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d2ba-54d1-4565-927f-267e2d64319d admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.514648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d2ba-54d1-4565-927f-267e2d64319d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.514915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d2ba-54d1-4565-927f-267e2d64319d admin admin] PATH_INFO: `/v3/projects/1fa495a14f8145bcb8bb9bbadf3f8596/users/ed9aed6f605f4c54bb2c979e04c9a34e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.517613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d2ba-54d1-4565-927f-267e2d64319d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa495a14f8145bcb8bb9bbadf3f8596, user_id=ed9aed6f605f4c54bb2c979e04c9a34e, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:47.522354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:47.523033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.523318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.523594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.525140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d2ba-54d1-4565-927f-267e2d64319d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:47.543924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:47.545397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:47.554957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 986/1985] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:47 2022] PUT /identity/v3/projects/1fa495a14f8145bcb8bb9bbadf3f8596/users/ed9aed6f605f4c54bb2c979e04c9a34e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:47.570313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.570847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.573016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.573292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1000/1986] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:47.632555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] MFA Rules not processed for user `ed9aed6f605f4c54bb2c979e04c9a34e`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:47.634116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:47.736492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 987/1987] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:47.748782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.750321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:47.818445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e141e6-be37-41ab-a9a2-71a2636fc278 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:47.871714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:47.872439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:47.872743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:47.873116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:47.884212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:47.885971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:47.890409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:47.892231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:47.904138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1001/1988] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:47.997621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977f7b7-04e7-435a-822b-7ce9035f8889 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:48.009154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:48.010331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:48.010331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:48.010630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] PATH_INFO: `/v3/projects/35aab1aa5dcc4e889adfaf0c4b1a5636` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:48.011921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35aab1aa5dcc4e889adfaf0c4b1a5636)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:48.013951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:48.035864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:48.052270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47cfc4-6254-482d-b8c3-f21d784d2a7b service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:48.062192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:48.062932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:48.063878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:48.064199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:48.069614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:48.107017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35aab1aa5dcc4e889adfaf0c4b1a5636', 'request_id': 'req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.125645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35aab1aa5dcc4e889adfaf0c4b1a5636', 'request_id': 'req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.133614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35aab1aa5dcc4e889adfaf0c4b1a5636', 'request_id': 'req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.145874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] The token cache is being invalidate because project 35aab1aa5dcc4e889adfaf0c4b1a5636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:48.146846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.146967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.152784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 988/1989] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:47 2022] DELETE /identity/v3/projects/35aab1aa5dcc4e889adfaf0c4b1a5636 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:48.153966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:48.155632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:48.182819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:48.184635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:48.225095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1002/1990] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:48.240974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae578b6-2f6d-4b77-8f64-d1707e3f239c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:48.249732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:48.250825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:48.251162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:48.251506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] PATH_INFO: `/v3/users/de0a4d6ff8144daa9ce0587ac4aaf62c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:48.261718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0a4d6ff8144daa9ce0587ac4aaf62c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:48.261718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:48.307534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0a4d6ff8144daa9ce0587ac4aaf62c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.316994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0a4d6ff8144daa9ce0587ac4aaf62c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.331457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0a4d6ff8144daa9ce0587ac4aaf62c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.332287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0a4d6ff8144daa9ce0587ac4aaf62c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.332918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0a4d6ff8144daa9ce0587ac4aaf62c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.351120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 989/1991] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:48 2022] DELETE /identity/v3/users/de0a4d6ff8144daa9ce0587ac4aaf62c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:48.751996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:48.770865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fdfad-26a3-4f6b-bb86-9db94c03506a service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:48.858210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:48.859712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:48.879158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:48.880054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:48.880333 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:48.880659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] PATH_INFO: `/v3/projects/8d61009d534b4d6e93dafa3afcbccce3` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:48.882633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d61009d534b4d6e93dafa3afcbccce3)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:48.886488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:48.962363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a21c5-bd6d-4ac9-ac8a-f14d5109ab13 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:48.969037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d61009d534b4d6e93dafa3afcbccce3', 'request_id': 'req-d67fe4b1-9f68-455a-8575-2362e006ba81'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.979242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d61009d534b4d6e93dafa3afcbccce3', 'request_id': 'req-d67fe4b1-9f68-455a-8575-2362e006ba81'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.988408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d61009d534b4d6e93dafa3afcbccce3', 'request_id': 'req-d67fe4b1-9f68-455a-8575-2362e006ba81'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:48.999388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] The token cache is being invalidate because project 8d61009d534b4d6e93dafa3afcbccce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:48.999631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.000293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d67fe4b1-9f68-455a-8575-2362e006ba81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.001872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1003/1992] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:48 2022] DELETE /identity/v3/projects/8d61009d534b4d6e93dafa3afcbccce3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:49.007424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441be911-4fb5-45ba-952c-0228fb2d3fee None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.007719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441be911-4fb5-45ba-952c-0228fb2d3fee None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.008145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441be911-4fb5-45ba-952c-0228fb2d3fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.029515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-441be911-4fb5-45ba-952c-0228fb2d3fee None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:49.031737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-441be911-4fb5-45ba-952c-0228fb2d3fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.032662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.033724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.034852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.035256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] PATH_INFO: `/v3/users/1cd783f6321d4618b3a92e2d6d619e92` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.037075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd783f6321d4618b3a92e2d6d619e92)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.038789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.041907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1004/1993] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:49.051325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.051325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.051325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.069777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:49.071093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.086037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1005/1994] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:49.087733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.097638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551970-b1ca-4844-968d-4b07e02dfbe9 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.102794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.103465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.103751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.104028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.104750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:49.104868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd783f6321d4618b3a92e2d6d619e92'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.105056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.106721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.114351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd783f6321d4618b3a92e2d6d619e92'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.120438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1006/1995] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:51:49.125178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.129875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd783f6321d4618b3a92e2d6d619e92'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.131250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd783f6321d4618b3a92e2d6d619e92'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.132030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0c331234-388a-4dbc-8a6b-39b81c4d6fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd783f6321d4618b3a92e2d6d619e92'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.135417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230bd95-7d8e-45ca-9856-e1a095ec2f3c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.141444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.142825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.143364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.144001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.144910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.145345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 990/1996] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:48 2022] DELETE /identity/v3/users/1cd783f6321d4618b3a92e2d6d619e92 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:49.147707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.149914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.150215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.150501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.169948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:49.171093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.177056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1007/1997] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:49 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:49.180992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.182802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.254005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 991/1998] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:49.260898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fa4fa-caaa-4619-9c1a-2e018ffc7238 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.265421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.267279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.267742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.270196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.270832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.271173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.272073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.274741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.301900 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1008/1999] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:49 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:49.304141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.326941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4e41-52e1-4a0a-865a-ec055279b825 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.339528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.340567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.341202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.342043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c83d3-c15a-4852-af98-cf8fcdb587d7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.342561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.345772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.349785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.371504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1009/2000] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:49.372574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.386273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af17cd-eb9c-4580-9f83-9109300bf326 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.391918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.393035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.393480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.394238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.394972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.396912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.407923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1010/2001] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:49.412438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.417951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8293e5-0de7-4476-8370-e254a62d0446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.418777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8293e5-0de7-4476-8370-e254a62d0446 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.419167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8293e5-0de7-4476-8370-e254a62d0446 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.419543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8293e5-0de7-4476-8370-e254a62d0446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.426511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6099e2-b031-4dee-991d-b848f003ee32 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.434413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.435514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.435813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.436094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] PATH_INFO: `/v3/projects/4c0e945e64844205b1df851fb73e1ea2/users/6cb5f67687dc4e9892e8ddd5c0aca940/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.440931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8293e5-0de7-4476-8370-e254a62d0446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.443077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8293e5-0de7-4476-8370-e254a62d0446 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.452633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 992/2002] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:49.455602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0e945e64844205b1df851fb73e1ea2, user_id=6cb5f67687dc4e9892e8ddd5c0aca940, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.458828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.473819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1011/2003] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:49 2022] PUT /identity/v3/projects/4c0e945e64844205b1df851fb73e1ea2/users/6cb5f67687dc4e9892e8ddd5c0aca940/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:49.478763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.479054 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.479695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.500547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:49.502519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.582507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 993/2004] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:49.604627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.606384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.717987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2afb9-d786-4fb9-a427-b50d8ae9cb4c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.724184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58e6fa-18e7-431f-82af-2de4bf2453aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.725281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e6fa-18e7-431f-82af-2de4bf2453aa service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.726282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e6fa-18e7-431f-82af-2de4bf2453aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.726789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e6fa-18e7-431f-82af-2de4bf2453aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.742407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58e6fa-18e7-431f-82af-2de4bf2453aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.744048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58e6fa-18e7-431f-82af-2de4bf2453aa service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.756463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1012/2005] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:49.836534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:49.837945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:49.857814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501551d6-e080-49ed-97e1-ab4b6616bf09 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:49.863806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:49.864513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:49.864679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:49.865055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] PATH_INFO: `/v3/projects/6a6a4e00524142248305a2a19222054b` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:49.867665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6a4e00524142248305a2a19222054b)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:49.869904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:49.929617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6a4e00524142248305a2a19222054b', 'request_id': 'req-11bd24a4-b5de-4dfe-aaef-07e113e37733'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.943226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6a4e00524142248305a2a19222054b', 'request_id': 'req-11bd24a4-b5de-4dfe-aaef-07e113e37733'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.963064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6a4e00524142248305a2a19222054b', 'request_id': 'req-11bd24a4-b5de-4dfe-aaef-07e113e37733'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.996645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] The token cache is being invalidate because project 6a6a4e00524142248305a2a19222054b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:49.996939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:49.997645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-11bd24a4-b5de-4dfe-aaef-07e113e37733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:50.007658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 994/2006] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:49 2022] DELETE /identity/v3/projects/6a6a4e00524142248305a2a19222054b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:50.011226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.011749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.012385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.048139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:50.049397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:50.154983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1013/2007] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:50.164744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.165246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.165675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.198952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:50.200410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:50.212187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 995/2008] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:50.216475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.228773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79639d9c-4045-4685-9e99-b4d904ff3a03 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.244908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.245990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.246610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.247174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.248162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:50.248769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.251967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.290709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1014/2009] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:51:50.294838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.305524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3834a1e-f6ea-4960-ab74-d9a101f4ea01 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.311333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.312162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.312557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.313109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.314371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.316580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.359848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 996/2010] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:50 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:50.364986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.380585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8120-ad90-4197-9ef6-e88724bfd511 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.496774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.497937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.498430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.498907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.499817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.502485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.545020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1015/2011] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:50 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:50.548727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.562938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b179-c970-4354-ad18-db180ee29e32 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.569205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.569984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.570268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.570552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.572050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.573683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.590082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 997/2012] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:50.594127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.608835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311666-0354-48f3-8292-30e17ca18f72 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.615808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a455a-f35e-4b89-b713-b1d82443a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.616498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a455a-f35e-4b89-b713-b1d82443a577 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.616781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a455a-f35e-4b89-b713-b1d82443a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.617059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a455a-f35e-4b89-b713-b1d82443a577 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.617793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a455a-f35e-4b89-b713-b1d82443a577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.620108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a455a-f35e-4b89-b713-b1d82443a577 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.641027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1016/2013] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:50.645710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.656673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3f1ec-6eb0-4dfd-9157-f41d528c6856 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.663802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc9fb-9bc6-4abb-8b22-6c763df1fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.665118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc9fb-9bc6-4abb-8b22-6c763df1fdad admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.665118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc9fb-9bc6-4abb-8b22-6c763df1fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.665353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc9fb-9bc6-4abb-8b22-6c763df1fdad admin admin] PATH_INFO: `/v3/projects/cae6cdd15ca0467e85c9d102d4930b48/users/2db713a7db2e4608ba841fe74ed53e8d/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.684157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc9fb-9bc6-4abb-8b22-6c763df1fdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae6cdd15ca0467e85c9d102d4930b48, user_id=2db713a7db2e4608ba841fe74ed53e8d, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.686862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc9fb-9bc6-4abb-8b22-6c763df1fdad admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.706913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 998/2014] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:50 2022] PUT /identity/v3/projects/cae6cdd15ca0467e85c9d102d4930b48/users/2db713a7db2e4608ba841fe74ed53e8d/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:50.718231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.718566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.718794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.762782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] MFA Rules not processed for user `2db713a7db2e4608ba841fe74ed53e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:50.764073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:50.772362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.772654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.772949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.804732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] MFA Rules not processed for user `6cb5f67687dc4e9892e8ddd5c0aca940`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:50.806199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:50.848586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1017/2015] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:50.861249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.863223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:50.897394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 999/2016] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:50.909831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:50.911820 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:50.944859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593cb06-3bde-4e03-9e23-54a3ab5f12b4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:50.951020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa556-8c6e-4473-9abe-db7bd7fe5168 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:50.952411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa556-8c6e-4473-9abe-db7bd7fe5168 service glance] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:50.952934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa556-8c6e-4473-9abe-db7bd7fe5168 service glance] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:50.953689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa556-8c6e-4473-9abe-db7bd7fe5168 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:50.964112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa556-8c6e-4473-9abe-db7bd7fe5168 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:50.965911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa556-8c6e-4473-9abe-db7bd7fe5168 service glance] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:50.976475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1018/2017] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:51.008874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36a84b-fed3-4e6e-8664-2c554abb92e7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:51.012656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:51.013316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:51.013604 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:51.013930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:51.023676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:51.025390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:51.037888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1000/2018] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:52.478673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4ce0-86c5-4b45-bf2d-199e32fc9663 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:52.479228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4ce0-86c5-4b45-bf2d-199e32fc9663 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:52.479228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4ce0-86c5-4b45-bf2d-199e32fc9663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:52.499887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ac8b4ce0-86c5-4b45-bf2d-199e32fc9663 None None] MFA Rules not processed for user `6cb5f67687dc4e9892e8ddd5c0aca940`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:52.501973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ac8b4ce0-86c5-4b45-bf2d-199e32fc9663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:52.515920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1019/2019] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:53.714300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:53.714300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:53.873805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93340eb8-72a3-4a4c-982b-715376c8ad70 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:53.878949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:53.880322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:53.892295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:53.894420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] PATH_INFO: `/v3/users/ef3a4763a62749b28f68ef20b47beb36` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:53.896607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3a4763a62749b28f68ef20b47beb36)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:53.900468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:54.041430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3a4763a62749b28f68ef20b47beb36'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.056885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3a4763a62749b28f68ef20b47beb36'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.087142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3a4763a62749b28f68ef20b47beb36'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.088174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3a4763a62749b28f68ef20b47beb36'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.088986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3a4763a62749b28f68ef20b47beb36'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.108484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1001/2020] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:53 2022] DELETE /identity/v3/users/ef3a4763a62749b28f68ef20b47beb36 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:54.114323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:54.114323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:54.114323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:54.140244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:54.142174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:54.152856 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:54.154985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:54.233788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1020/2021] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:54.235013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b195be-41c4-4f03-9d11-8d9b9224622f admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:54.241302 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:54.242346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:54.242738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:54.243177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] PATH_INFO: `/v3/users/93eec5f7fcf745ea91a643cbbe7bbd4b` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:54.244561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=93eec5f7fcf745ea91a643cbbe7bbd4b)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:54.246157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:54.247153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:54.247836 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:54.352163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93eec5f7fcf745ea91a643cbbe7bbd4b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.361748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93eec5f7fcf745ea91a643cbbe7bbd4b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.366818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49839d78-f2f9-4b5c-a347-913c79a01771 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:54.371972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:54.372644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:54.375495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:54.375892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:54.377139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93eec5f7fcf745ea91a643cbbe7bbd4b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.378144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93eec5f7fcf745ea91a643cbbe7bbd4b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.378842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e009aad0-70eb-42b5-91b0-03db2ecd29fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93eec5f7fcf745ea91a643cbbe7bbd4b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:54.400656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1002/2022] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:54 2022] DELETE /identity/v3/users/93eec5f7fcf745ea91a643cbbe7bbd4b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:54.402258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:54.402646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:54.402958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:54.403077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:54.404489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:54.422345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1021/2023] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:51:54.448565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:54.451466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:54.584244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1003/2024] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:54.615233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:54.616928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:54.629541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb611cb-1843-4a7f-b67a-4bf041b5600b service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:54.711574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:54.712645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:54.712997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:54.713522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:54.726879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:54.728543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:54.758184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1022/2025] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:55.193710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:55.195242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:55.209914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77602-a1e0-408a-9071-dfb7e71bdc36 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:55.217786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:55.218948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:55.219411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:55.219833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] PATH_INFO: `/v3/projects/1814326e337041289cca51c94dd73761` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:55.221200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1814326e337041289cca51c94dd73761)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:55.224076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:55.280163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1814326e337041289cca51c94dd73761', 'request_id': 'req-6593856c-e8fd-4df9-9891-729a58f7b9ea'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.289204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1814326e337041289cca51c94dd73761', 'request_id': 'req-6593856c-e8fd-4df9-9891-729a58f7b9ea'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.297658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1814326e337041289cca51c94dd73761', 'request_id': 'req-6593856c-e8fd-4df9-9891-729a58f7b9ea'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.311145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] The token cache is being invalidate because project 1814326e337041289cca51c94dd73761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:55.311756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.312617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.315551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1004/2026] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:55 2022] DELETE /identity/v3/projects/1814326e337041289cca51c94dd73761 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:55.319535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:55.331344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33258c99-8177-4372-9747-c9d5555733b1 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:55.405714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:55.406656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:55.406939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:55.407216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] PATH_INFO: `/v3/users/731218baa14a4b558af26d8aca909426` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:55.408429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731218baa14a4b558af26d8aca909426)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:55.410711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:55.461291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731218baa14a4b558af26d8aca909426'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.473448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731218baa14a4b558af26d8aca909426'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.489516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731218baa14a4b558af26d8aca909426'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.490428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731218baa14a4b558af26d8aca909426'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.500905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731218baa14a4b558af26d8aca909426'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.508407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1023/2027] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:55 2022] DELETE /identity/v3/users/731218baa14a4b558af26d8aca909426 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:55.707908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:55.709352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:55.722221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593856c-e8fd-4df9-9891-729a58f7b9ea admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:55.836316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:55.837768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:55.838323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:55.838743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] PATH_INFO: `/v3/projects/959f57c3e9a4418f91406720022e2186` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:55.840248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=959f57c3e9a4418f91406720022e2186)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:55.842461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:55.923115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959f57c3e9a4418f91406720022e2186', 'request_id': 'req-cb3004d5-345d-47f1-a6be-69dd6ea98c70'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.953989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959f57c3e9a4418f91406720022e2186', 'request_id': 'req-cb3004d5-345d-47f1-a6be-69dd6ea98c70'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.969621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959f57c3e9a4418f91406720022e2186', 'request_id': 'req-cb3004d5-345d-47f1-a6be-69dd6ea98c70'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.992517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] The token cache is being invalidate because project 959f57c3e9a4418f91406720022e2186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:55.993268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.995030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:55.997026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1005/2028] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:55 2022] DELETE /identity/v3/projects/959f57c3e9a4418f91406720022e2186 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:56.001694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:56.004288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:56.019303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91fc25-c198-4c28-9308-204ced6eb611 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:56.101618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:56.102796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:56.103073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:56.103342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] PATH_INFO: `/v3/users/ed9aed6f605f4c54bb2c979e04c9a34e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:56.104825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9aed6f605f4c54bb2c979e04c9a34e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:56.106891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:56.162371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9aed6f605f4c54bb2c979e04c9a34e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:56.171664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9aed6f605f4c54bb2c979e04c9a34e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:56.195637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9aed6f605f4c54bb2c979e04c9a34e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:56.197557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9aed6f605f4c54bb2c979e04c9a34e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:56.204283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9aed6f605f4c54bb2c979e04c9a34e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:56.212137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1024/2029] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:56 2022] DELETE /identity/v3/users/ed9aed6f605f4c54bb2c979e04c9a34e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:56.657580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:56.660174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:56.676306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3004d5-345d-47f1-a6be-69dd6ea98c70 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:56.751695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:56.754828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:56.804221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:56.809652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:56.811419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:56.811963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] PATH_INFO: `/v3/projects/1fa495a14f8145bcb8bb9bbadf3f8596` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:56.819425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa495a14f8145bcb8bb9bbadf3f8596)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:56.847321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:56.858782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1508-1b85-4459-b1b0-065330c1d972 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:56.866448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:56.867862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:56.868364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:56.869071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] PATH_INFO: `/v3/projects/54653a2bf38b4578bd70d977ae23207a` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:56.870853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54653a2bf38b4578bd70d977ae23207a)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:56.873244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:56.968813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54653a2bf38b4578bd70d977ae23207a', 'request_id': 'req-3900c174-d8d2-40cf-a091-939db6c8870c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:56.990432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54653a2bf38b4578bd70d977ae23207a', 'request_id': 'req-3900c174-d8d2-40cf-a091-939db6c8870c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.016158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54653a2bf38b4578bd70d977ae23207a', 'request_id': 'req-3900c174-d8d2-40cf-a091-939db6c8870c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.035698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] The token cache is being invalidate because project 54653a2bf38b4578bd70d977ae23207a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:57.036316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.037443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3900c174-d8d2-40cf-a091-939db6c8870c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.039712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1025/2030] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:56 2022] DELETE /identity/v3/projects/54653a2bf38b4578bd70d977ae23207a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:57.044871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae0cb-df28-4ff9-ba03-2392ff11c76c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.046148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae0cb-df28-4ff9-ba03-2392ff11c76c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.048686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae0cb-df28-4ff9-ba03-2392ff11c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.056588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa495a14f8145bcb8bb9bbadf3f8596', 'request_id': 'req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.074074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa495a14f8145bcb8bb9bbadf3f8596', 'request_id': 'req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.093718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa495a14f8145bcb8bb9bbadf3f8596', 'request_id': 'req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.099136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-921ae0cb-df28-4ff9-ba03-2392ff11c76c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:57.101972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-921ae0cb-df28-4ff9-ba03-2392ff11c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:57.108682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] The token cache is being invalidate because project 1fa495a14f8145bcb8bb9bbadf3f8596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:51:57.109606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.110777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-e349f8fa-cc63-4bc4-9e9f-683415b9a43f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:51:57.112776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1006/2031] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:51:56 2022] DELETE /identity/v3/projects/1fa495a14f8145bcb8bb9bbadf3f8596 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:57.119082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a755b-028e-43f3-a6fb-5a6d98000e1e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.121229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a755b-028e-43f3-a6fb-5a6d98000e1e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.121752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a755b-028e-43f3-a6fb-5a6d98000e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.148240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-006a755b-028e-43f3-a6fb-5a6d98000e1e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:57.150053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-006a755b-028e-43f3-a6fb-5a6d98000e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:57.243151 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1026/2032] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:57.259032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1007/2033] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:57.260548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.261190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.261717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.285361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.285939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.286376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.311315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:57.312586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:57.331475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:57.333109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:57.336889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1008/2034] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:57.342556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.358513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfd5b4-290b-4524-9161-845f25dbc8e0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.364398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1027/2035] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:57.368394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.372219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.373086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.380375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.380876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.382051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:57.382605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.384452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.391008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb27b36-1531-4214-ac6b-9c30725e96bc None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.399611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.400287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.400574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.400839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1009/2036] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:57.400944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.401722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:51:57.402067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.403724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.405145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.421727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1028/2037] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:51:57.425268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a87a-c07f-402f-adf2-a44d2832139a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.425941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.438835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.439742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.441935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369e79a-99eb-4283-9ec8-f55d16871945 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.442098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.442098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.444093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.446705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.447111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.447593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.447976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.448353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.449146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.451441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.499372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1029/2038] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:57.501217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.524211 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1010/2039] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:57.531216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.634732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cb99e-1f8d-4bfb-8862-a2ed587751a1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.641692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.642559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.643793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.644053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.644727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.647338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004306b-e0e9-4ab5-8669-1a693ab9b50c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.648936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.653715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.654934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.655579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.656080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.657129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.660002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.690691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1011/2040] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:57.691696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.698031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1030/2041] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:57.701523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.707243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109384-1a34-474c-bc8f-3bb5bd1429ed admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.713215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.714396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.714687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.715443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.715682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.717288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.718440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7f5bf-cf7d-410a-a07a-e2c95a4d6f0b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.726114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.729052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.730043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1012/2042] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:57.730495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.731092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.732777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.734601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.737688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.746513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9da9fe-28d9-47bc-ad60-f552addaef10 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.754450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1031/2043] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:57.757203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.758180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.758474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.759012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.759220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.759882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.762904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.773610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60647-7cfc-4845-b4a3-4f52c382f731 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.777257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1013/2044] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:57.779501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.780508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.780976 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.781318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.781969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.782996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.785721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.793872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9fa4-22ac-4a8d-be58-d0ba85b5cba7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.799972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dadf7-4ecc-44d7-8cc2-96e42fd3dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.800866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1032/2045] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:57.804620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dadf7-4ecc-44d7-8cc2-96e42fd3dc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.804913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dadf7-4ecc-44d7-8cc2-96e42fd3dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.805195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dadf7-4ecc-44d7-8cc2-96e42fd3dc54 admin admin] PATH_INFO: `/v3/projects/6e13881085594e1297e6a5a1f0da5eca/users/2e07b4469c294d83a83687e00827789d/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.805733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:57.827941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dadf7-4ecc-44d7-8cc2-96e42fd3dc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e13881085594e1297e6a5a1f0da5eca, user_id=2e07b4469c294d83a83687e00827789d, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:57.832149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dadf7-4ecc-44d7-8cc2-96e42fd3dc54 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:57.840936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75fa8-975b-4af5-ad37-3ccf3d604825 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:57.859792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1014/2046] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:57 2022] PUT /identity/v3/projects/6e13881085594e1297e6a5a1f0da5eca/users/2e07b4469c294d83a83687e00827789d/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:57.861930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.862340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.862626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:57.908089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] MFA Rules not processed for user `2e07b4469c294d83a83687e00827789d`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:57.911420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:57.987126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ad098-2197-40a8-868b-47813ece3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:57.988563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad098-2197-40a8-868b-47813ece3401 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:57.988854 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad098-2197-40a8-868b-47813ece3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:57.989257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad098-2197-40a8-868b-47813ece3401 admin admin] PATH_INFO: `/v3/projects/116c045881cb4a9a98d0c02b47f5ca33/users/14f1a2f4dae34505b8521a7b99cc58d8/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.008165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ad098-2197-40a8-868b-47813ece3401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116c045881cb4a9a98d0c02b47f5ca33, user_id=14f1a2f4dae34505b8521a7b99cc58d8, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.011944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ad098-2197-40a8-868b-47813ece3401 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.025650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1015/2047] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:58.030629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.031939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1033/2048] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:57 2022] PUT /identity/v3/projects/116c045881cb4a9a98d0c02b47f5ca33/users/14f1a2f4dae34505b8521a7b99cc58d8/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:51:58.044025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.044697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.045123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.053777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eca30-0401-4c46-9917-12fd4141ad3e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.079700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] MFA Rules not processed for user `14f1a2f4dae34505b8521a7b99cc58d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:58.082131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:58.157366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.158353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.159068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.159415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.160177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.165074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.180653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1034/2049] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:58.185965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.199846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1016/2050] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:58.200036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab96a7-c1da-4c1b-a0ac-72b6283a230c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.203171 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.293556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.294267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.294544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.294808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e17d-aa60-4e9e-9aec-7c5abba84441 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.294909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.295496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.297479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.300640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.301535 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.302222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.307042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.307923 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.310026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.326554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1035/2051] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:58.331490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.336536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1017/2052] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:58.340332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.350231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69297577-a06e-4779-8808-be40b192a9c3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.412305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772eb97-0286-49aa-abaf-3a6ebcae371a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.420830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.421558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.422041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.422438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.423198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.425846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.426046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.426892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.427266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.427692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.428510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.430440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.444218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1018/2053] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:58.447488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.456791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1036/2054] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:51:58.457914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.459585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34252-469d-42eb-b6d0-bcbc6522461d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.466850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.467527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.467813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.468095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.468580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8f41d-d68f-49b4-af85-11bd5f0c1ec1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.468814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.470749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.473576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.474357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.474690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.474965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.475686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.477342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.488964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1019/2055] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:58.490111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.501705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae8819-9b21-491e-884a-09e316a9e2b1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.506669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1037/2056] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:58.507961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.512273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478a9db-7fd8-4415-95ee-c7b1d30c72ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.515553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a9db-7fd8-4415-95ee-c7b1d30c72ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.515990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a9db-7fd8-4415-95ee-c7b1d30c72ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.517002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a9db-7fd8-4415-95ee-c7b1d30c72ad admin admin] PATH_INFO: `/v3/projects/9e3e37c6d3084d9eb0b2df5609002e0d/users/e8c845240e814cad837520949192abb0/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.519557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699f30d-ebd9-40d0-b975-99d58d0d302d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.536021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.538302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.538428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478a9db-7fd8-4415-95ee-c7b1d30c72ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3e37c6d3084d9eb0b2df5609002e0d, user_id=e8c845240e814cad837520949192abb0, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.538901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.539278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] PATH_INFO: `/v3/projects/40306e358fa64f0c9ec30c0939d5264e/users/b8ea7cb2da3548ce9d09d4e9679ae012/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.542399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478a9db-7fd8-4415-95ee-c7b1d30c72ad admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.559740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40306e358fa64f0c9ec30c0939d5264e, user_id=b8ea7cb2da3548ce9d09d4e9679ae012, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.563506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.565985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1020/2057] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:58 2022] PUT /identity/v3/projects/9e3e37c6d3084d9eb0b2df5609002e0d/users/e8c845240e814cad837520949192abb0/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:58.573989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.574400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.574713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.589054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1038/2058] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:58 2022] PUT /identity/v3/projects/40306e358fa64f0c9ec30c0939d5264e/users/b8ea7cb2da3548ce9d09d4e9679ae012/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:58.592793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.675475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] MFA Rules not processed for user `e8c845240e814cad837520949192abb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:58.677049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:58.685752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b115f-95b0-41be-9d83-686422cddc28 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.691794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.693737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.694022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.694256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.695004 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.696637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.710075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1039/2059] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:58.714047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.758210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d5f7c-6566-4b29-83f1-c3c52ee1d036 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.764779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef217519-27c8-42cc-83ee-16441f1a0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.765725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef217519-27c8-42cc-83ee-16441f1a0579 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.766070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef217519-27c8-42cc-83ee-16441f1a0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.766348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef217519-27c8-42cc-83ee-16441f1a0579 admin admin] PATH_INFO: `/v3/projects/40306e358fa64f0c9ec30c0939d5264e/users/b8ea7cb2da3548ce9d09d4e9679ae012/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.774879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef217519-27c8-42cc-83ee-16441f1a0579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40306e358fa64f0c9ec30c0939d5264e, user_id=b8ea7cb2da3548ce9d09d4e9679ae012, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.778464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef217519-27c8-42cc-83ee-16441f1a0579 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:58.819982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1040/2060] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:58 2022] PUT /identity/v3/projects/40306e358fa64f0c9ec30c0939d5264e/users/b8ea7cb2da3548ce9d09d4e9679ae012/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:58.822838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.823338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.823870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.856474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] MFA Rules not processed for user `b8ea7cb2da3548ce9d09d4e9679ae012`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:58.857741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:58.868225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1021/2061] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:58.872481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.896741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd250-a3d3-4633-a9e7-88b64281071a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:58.958220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1041/2062] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:51:58.972186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:58.972506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:58.973205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:58.973508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:58.973780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:58.974279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:58.974610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:58.976744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.006409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1022/2063] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:51:58 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:59.010353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.041526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbd819-27a8-4453-8574-33e425e58c0c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.074764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7d278-58b8-4626-9ac4-384bd31db948 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.079384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.080045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.080331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.081188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.081957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.083871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.089302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.090097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.090392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.090680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.109369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1023/2064] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:51:59 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:51:59.113333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.129137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499b5bf-e510-4633-997d-cea038229d35 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.133968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.134677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.134959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.135240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.135968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.137593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.148191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1024/2065] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:51:59.152747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.162454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c95b1-0a41-4045-8ddb-4addb5dc467a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.166009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.167307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.167530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.168186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.168466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.168741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] PATH_INFO: `/v3/projects/f1a4b4a5724148d487594e4eea1c3ede/users/3dec7f31c9204f38983126d27285b188/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.178366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1042/2066] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:59.187120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4b4a5724148d487594e4eea1c3ede, user_id=3dec7f31c9204f38983126d27285b188, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.191187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.206556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1025/2067] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:59 2022] PUT /identity/v3/projects/f1a4b4a5724148d487594e4eea1c3ede/users/3dec7f31c9204f38983126d27285b188/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:59.211777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.226513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c2c10-104c-4edf-a533-68d3097b0e9e service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.294893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a28aca-5e38-418c-b001-1cc6cfc6f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.295661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a28aca-5e38-418c-b001-1cc6cfc6f983 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.296015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a28aca-5e38-418c-b001-1cc6cfc6f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.296357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a28aca-5e38-418c-b001-1cc6cfc6f983 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.297216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a28aca-5e38-418c-b001-1cc6cfc6f983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.298996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a28aca-5e38-418c-b001-1cc6cfc6f983 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.308916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1043/2068] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:51:59.313460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.323648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1718016-40dc-48a9-b4a7-adeff7d300f3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.328242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.329129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.329410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.329686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] PATH_INFO: `/v3/projects/f1a4b4a5724148d487594e4eea1c3ede/users/3dec7f31c9204f38983126d27285b188/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.332548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4b4a5724148d487594e4eea1c3ede, user_id=3dec7f31c9204f38983126d27285b188, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.335575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.346729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1026/2069] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:51:59 2022] PUT /identity/v3/projects/f1a4b4a5724148d487594e4eea1c3ede/users/3dec7f31c9204f38983126d27285b188/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:51:59.357709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.358035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.358310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.385780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] MFA Rules not processed for user `3dec7f31c9204f38983126d27285b188`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:51:59.387318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:51:59.463492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1044/2070] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:51:59.475053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.550543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85f14b-fc93-4e12-a38b-d8a795bac959 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.557064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa650b93-e807-487b-96b6-f05abd3a7e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.557720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650b93-e807-487b-96b6-f05abd3a7e0c service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.558170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650b93-e807-487b-96b6-f05abd3a7e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.558453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650b93-e807-487b-96b6-f05abd3a7e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.569259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa650b93-e807-487b-96b6-f05abd3a7e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.570747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa650b93-e807-487b-96b6-f05abd3a7e0c service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:51:59.581323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1027/2071] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:51:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:51:59.778555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:51:59.884175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d202fe6-61d5-4319-9b2c-b19520dd03e4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:51:59.895207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:51:59.897552 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:51:59.898168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:51:59.898474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] PATH_INFO: `/v3/users/14f1a2f4dae34505b8521a7b99cc58d8` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:51:59.902200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f1a2f4dae34505b8521a7b99cc58d8)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:51:59.907787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:00.003525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f1a2f4dae34505b8521a7b99cc58d8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.016245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f1a2f4dae34505b8521a7b99cc58d8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.031828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f1a2f4dae34505b8521a7b99cc58d8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.036203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f1a2f4dae34505b8521a7b99cc58d8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.055217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f1a2f4dae34505b8521a7b99cc58d8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.062110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1045/2072] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:51:59 2022] DELETE /identity/v3/users/14f1a2f4dae34505b8521a7b99cc58d8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:00.066873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:00.067945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:00.067945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:00.088864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:00.090250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:00.179944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1028/2073] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:00.189975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:00.191597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:00.287735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64312576-2954-4dd0-b7a7-6838c09f6ad7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:00.297559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:00.298616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:00.299073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:00.299544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:00.310928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:00.312383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:00.326007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1046/2074] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:00.342512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:00.345424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:00.420323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b921-252d-4823-a916-e7e208f32dd2 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:00.425064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:00.426113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:00.426787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:00.427347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:00.429662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:00.532618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:00.534849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:00.555807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1029/2075] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:00.677020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:00.678959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:00.712348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51706555-c7e4-4b36-835b-e81be183f2b3 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:00.718420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:00.719470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:00.720116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:00.720671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] PATH_INFO: `/v3/projects/116c045881cb4a9a98d0c02b47f5ca33` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:00.722987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=116c045881cb4a9a98d0c02b47f5ca33)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:00.726339 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:00.778593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116c045881cb4a9a98d0c02b47f5ca33', 'request_id': 'req-344f48eb-09df-483c-9aca-77041862b7fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.788505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116c045881cb4a9a98d0c02b47f5ca33', 'request_id': 'req-344f48eb-09df-483c-9aca-77041862b7fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.795905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116c045881cb4a9a98d0c02b47f5ca33', 'request_id': 'req-344f48eb-09df-483c-9aca-77041862b7fe'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.808318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] The token cache is being invalidate because project 116c045881cb4a9a98d0c02b47f5ca33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:00.808844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.809511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.811609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1047/2076] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:00 2022] DELETE /identity/v3/projects/116c045881cb4a9a98d0c02b47f5ca33 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:00.815849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:00.841066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754a4f0-76c2-4b75-bfed-69fcae25d83a service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:00.915422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:00.916311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:00.916602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:00.916876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] PATH_INFO: `/v3/users/b8ea7cb2da3548ce9d09d4e9679ae012` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:00.918540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ea7cb2da3548ce9d09d4e9679ae012)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:00.922063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:00.981749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ea7cb2da3548ce9d09d4e9679ae012'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.988897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ea7cb2da3548ce9d09d4e9679ae012'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:00.999872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ea7cb2da3548ce9d09d4e9679ae012'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.000472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ea7cb2da3548ce9d09d4e9679ae012'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.001063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-57a6f8a9-ee01-461b-88be-badeba48d8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ea7cb2da3548ce9d09d4e9679ae012'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.013525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1030/2077] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:00 2022] DELETE /identity/v3/users/b8ea7cb2da3548ce9d09d4e9679ae012 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:01.364175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.365751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:01.380346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f48eb-09df-483c-9aca-77041862b7fe admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.453160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.454066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.454348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.454621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] PATH_INFO: `/v3/projects/40306e358fa64f0c9ec30c0939d5264e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.460879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40306e358fa64f0c9ec30c0939d5264e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:01.462922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:01.511561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40306e358fa64f0c9ec30c0939d5264e', 'request_id': 'req-59407d03-9f9d-48ed-a827-30f14afb0077'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.519574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40306e358fa64f0c9ec30c0939d5264e', 'request_id': 'req-59407d03-9f9d-48ed-a827-30f14afb0077'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.531175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40306e358fa64f0c9ec30c0939d5264e', 'request_id': 'req-59407d03-9f9d-48ed-a827-30f14afb0077'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.547175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] The token cache is being invalidate because project 40306e358fa64f0c9ec30c0939d5264e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:01.547464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.548244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-59407d03-9f9d-48ed-a827-30f14afb0077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:01.549879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1048/2078] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:01 2022] DELETE /identity/v3/projects/40306e358fa64f0c9ec30c0939d5264e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:01.554997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.555529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.555529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.574333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:01.575553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:01.635350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1031/2079] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:01.646440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.646851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.647025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.668650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:01.669870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:01.681067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1049/2080] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:01.684650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.695111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c576a7-89d1-4203-ade8-f9b98deea3e8 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.699713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.700422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.700717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.701001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.701720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:01.702066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:01.703665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:01.716091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1032/2081] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:01.720260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.730067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b79e6f-4abe-47df-a79f-9621f7771339 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.734733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.735380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.735663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.735954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.736650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:01.738605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:01.770853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1050/2082] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:01 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:01.773697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.785002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655ed29-9864-402a-b8a7-7695b9b43a1d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.839972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.840642 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.840927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.841204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.841914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:01.843834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:01.866968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1033/2083] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:01 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:01.868236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.878994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558ae6-a9aa-436a-aad2-6c8acb8e400a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.892689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.894104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.894435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.894713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.895587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:01.897281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:01.911834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1051/2084] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:01.913596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.923606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3c9c7-c099-4e85-9c85-4f1d1bb8842a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.930183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad47f31-52f5-498d-a27b-8addb05911ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.930835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47f31-52f5-498d-a27b-8addb05911ab admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.931210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47f31-52f5-498d-a27b-8addb05911ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.931562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47f31-52f5-498d-a27b-8addb05911ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.932352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad47f31-52f5-498d-a27b-8addb05911ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:01.934088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad47f31-52f5-498d-a27b-8addb05911ab admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:01.955017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:01.958102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1034/2085] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:01.969164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218aad9-b202-4e3a-95bd-f7fc6c4a7842 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:01.976407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:01.977503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:01.977956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:01.978592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] PATH_INFO: `/v3/projects/7e881e6d815e4626a38331b60c03675f/users/3547c1a8203f488fb66c5cd7033d5252/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:01.999480 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e881e6d815e4626a38331b60c03675f, user_id=3547c1a8203f488fb66c5cd7033d5252, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.003528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.040212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1052/2086] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:01 2022] PUT /identity/v3/projects/7e881e6d815e4626a38331b60c03675f/users/3547c1a8203f488fb66c5cd7033d5252/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:02.042324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.042613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.042894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.081087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] MFA Rules not processed for user `3547c1a8203f488fb66c5cd7033d5252`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:02.082198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.178215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1035/2087] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:02.182810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.206177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.207649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.275816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d798d-c145-465c-a1aa-c432de10f474 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.286264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.287075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.287450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.287978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.288771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.291327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.296791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549b849-e992-4efd-ac4f-9e2b278790f5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.302621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.303509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.303785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.304071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] PATH_INFO: `/v3/users/3a343c19dc5f4ca1bcf659d05ffa92c7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.305296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a343c19dc5f4ca1bcf659d05ffa92c7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.307425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.332433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1053/2088] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:02 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:02.335158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.363975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a343c19dc5f4ca1bcf659d05ffa92c7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.378847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a343c19dc5f4ca1bcf659d05ffa92c7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.395301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a343c19dc5f4ca1bcf659d05ffa92c7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.396156 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a343c19dc5f4ca1bcf659d05ffa92c7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.397006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a343c19dc5f4ca1bcf659d05ffa92c7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.417574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1036/2089] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:02 2022] DELETE /identity/v3/users/3a343c19dc5f4ca1bcf659d05ffa92c7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:02.425959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263cc33-97e2-4836-bb17-0b79693ad44e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.492622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.493431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.493719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.494028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.495140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.496856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.520097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1054/2090] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:02 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:02.524276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.525910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.540382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38617daf-7b44-4f19-b44a-185c817b0a9c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.545494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.546258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.546484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.546766 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.547900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.550010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.561075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1037/2091] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:02.565643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.579194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d09cbf-14cb-4fc3-813a-e10fe6173439 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.584980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.585735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.586047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.586322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] PATH_INFO: `/v3/projects/efb5c5da31754625ac4b0c493c7f7dc5/users/a25a411e9dfd46d991754e53feb11cc1/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.603274 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb5c5da31754625ac4b0c493c7f7dc5, user_id=a25a411e9dfd46d991754e53feb11cc1, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.606811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.625592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1055/2092] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:02 2022] PUT /identity/v3/projects/efb5c5da31754625ac4b0c493c7f7dc5/users/a25a411e9dfd46d991754e53feb11cc1/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:02.629756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.635401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.637506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.640064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117e27a-1022-435b-aff0-8049adcf5152 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.718853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.723446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.723914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.724300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.725234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.728886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.740643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1038/2093] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:02.747998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.758575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7caee-00f3-4fa3-8e38-9db29038da16 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.758867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413fe06-2c71-432f-8ef0-a63f444781f5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.763180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb0912-544f-40e4-a5eb-1ad194e6c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.764177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb0912-544f-40e4-a5eb-1ad194e6c017 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.764550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb0912-544f-40e4-a5eb-1ad194e6c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.764827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb0912-544f-40e4-a5eb-1ad194e6c017 admin admin] PATH_INFO: `/v3/projects/efb5c5da31754625ac4b0c493c7f7dc5/users/a25a411e9dfd46d991754e53feb11cc1/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.766850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb0912-544f-40e4-a5eb-1ad194e6c017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb5c5da31754625ac4b0c493c7f7dc5, user_id=a25a411e9dfd46d991754e53feb11cc1, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.769652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:02.769878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb0912-544f-40e4-a5eb-1ad194e6c017 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.770689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.771570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.771940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] PATH_INFO: `/v3/projects/46dce7630acc4cbc80b4cb3ba27c7dd9` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.774386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dce7630acc4cbc80b4cb3ba27c7dd9)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:02.777949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:02.780378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1039/2094] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:02 2022] PUT /identity/v3/projects/efb5c5da31754625ac4b0c493c7f7dc5/users/a25a411e9dfd46d991754e53feb11cc1/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:02.791801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.792236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.793069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.822224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] MFA Rules not processed for user `a25a411e9dfd46d991754e53feb11cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:02.823434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.839234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'request_id': 'req-90459f22-5e62-405b-95e8-6481e6b8e114'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.854911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'request_id': 'req-90459f22-5e62-405b-95e8-6481e6b8e114'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.863360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'request_id': 'req-90459f22-5e62-405b-95e8-6481e6b8e114'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.876115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] The token cache is being invalidate because project 46dce7630acc4cbc80b4cb3ba27c7dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:02.876749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.877906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-90459f22-5e62-405b-95e8-6481e6b8e114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:02.879935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1056/2095] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:02 2022] DELETE /identity/v3/projects/46dce7630acc4cbc80b4cb3ba27c7dd9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:02.884658 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3e09-519e-4a0b-b737-8c968298a83a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.885004 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3e09-519e-4a0b-b737-8c968298a83a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.885886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3e09-519e-4a0b-b737-8c968298a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:02.906090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-31de3e09-519e-4a0b-b737-8c968298a83a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:02.907914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-31de3e09-519e-4a0b-b737-8c968298a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.908908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1040/2096] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:02.916803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:02.918525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:02.986235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1057/2097] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:02.991251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a5c2-7951-4a34-958e-6fa13ca5114c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:02.996103 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:02.996474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:02.996754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.000300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.001154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.001510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.004260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.004793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:03.015786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:03.018315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:03.027783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1058/2098] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:03.032096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.041490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3873113-74b6-4631-96c3-d8d6a12575d9 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.046213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.046856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.047139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.047412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.048154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:03.048457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.050622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.062324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1059/2099] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:52:03.067789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.076807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.077054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abd81f-9ac9-4f11-a2c9-42836dcfb054 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.078278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.082383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.083020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.083299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.083576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.084249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.086165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.087325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1041/2100] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:03.114232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1060/2101] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:03 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:03.118780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.132636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0dc0-5e1a-455f-b7d9-3b4098673d9a service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.195318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.195995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.196276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.196551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.197246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.199202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.220619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1042/2102] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:03 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:03.225164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.236121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e775-6a01-4427-b771-42c308a8a917 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.241646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.242351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.243061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.243061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.243624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.245401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.260547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1061/2103] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:03.264606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.277450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212230-a2a4-43ad-acea-43b16035b298 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.283073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5329f-0201-4f45-b298-12a2229903fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.283795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5329f-0201-4f45-b298-12a2229903fa admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.284113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5329f-0201-4f45-b298-12a2229903fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.284396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5329f-0201-4f45-b298-12a2229903fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.285216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5329f-0201-4f45-b298-12a2229903fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.287028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5329f-0201-4f45-b298-12a2229903fa admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.302563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1043/2104] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:03.304008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.316924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310368f-b8c7-45aa-86a1-90c45ee2cf54 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.322626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.323709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.324119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.324505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] PATH_INFO: `/v3/projects/f33bda6601c0471c99d3bc2483fd1d88/users/bff4c66ef70848f18d7d10efc302e985/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.343450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33bda6601c0471c99d3bc2483fd1d88, user_id=bff4c66ef70848f18d7d10efc302e985, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.348207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.365087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1062/2105] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:03 2022] PUT /identity/v3/projects/f33bda6601c0471c99d3bc2483fd1d88/users/bff4c66ef70848f18d7d10efc302e985/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:03.380575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.381155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.382697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.434205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] MFA Rules not processed for user `bff4c66ef70848f18d7d10efc302e985`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:03.435708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:03.568187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1044/2106] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:03.572246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.653041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a359b07-524e-4bd8-afff-49154228c551 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.659651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.660367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.660648 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.660979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.661596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.663576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.694486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1063/2107] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:03 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:03.695931 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.708993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a32b7c-3aa6-4449-a98f-18703dfc8c5b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.764090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.764823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.765164 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.765466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.766202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.769920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.792061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1045/2108] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:03 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:03.796001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.806665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6a44-4d12-4904-84d5-487e9155b1fb admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.811468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.812174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.812454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.812756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.813738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.816688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.829276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1064/2109] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:03.833910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.844228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892eb7c-2c81-46b4-8ed2-554a4c551717 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.849613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.850607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.850892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.851168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] PATH_INFO: `/v3/projects/76bf96176cbf4992a76501f0f9a81993/users/ecb5d787875b451ab5318481d65fa2ec/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.867454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bf96176cbf4992a76501f0f9a81993, user_id=ecb5d787875b451ab5318481d65fa2ec, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.870130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.885332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1046/2110] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:03 2022] PUT /identity/v3/projects/76bf96176cbf4992a76501f0f9a81993/users/ecb5d787875b451ab5318481d65fa2ec/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:03.889220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.900165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd5ba-671c-4cbb-9a5a-137ca8beeff6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.955527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68944-bf45-4ef8-b011-b03ecef9ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.956192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68944-bf45-4ef8-b011-b03ecef9ecbc admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.956472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68944-bf45-4ef8-b011-b03ecef9ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.956747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68944-bf45-4ef8-b011-b03ecef9ecbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.957472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d68944-bf45-4ef8-b011-b03ecef9ecbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.959105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d68944-bf45-4ef8-b011-b03ecef9ecbc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:03.968664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1065/2111] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:03.972980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:03.982956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53df11-2cfa-4b8d-9276-a4e7a08d9282 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:03.988862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:03.989763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:03.990078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:03.990385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] PATH_INFO: `/v3/projects/76bf96176cbf4992a76501f0f9a81993/users/ecb5d787875b451ab5318481d65fa2ec/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:03.992351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bf96176cbf4992a76501f0f9a81993, user_id=ecb5d787875b451ab5318481d65fa2ec, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:03.995058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:04.005712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1047/2112] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:03 2022] PUT /identity/v3/projects/76bf96176cbf4992a76501f0f9a81993/users/ecb5d787875b451ab5318481d65fa2ec/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:04.015650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a643f1-b341-4274-a195-05678a66016b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:04.015937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a643f1-b341-4274-a195-05678a66016b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:04.016216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a643f1-b341-4274-a195-05678a66016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:04.043218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-32a643f1-b341-4274-a195-05678a66016b None None] MFA Rules not processed for user `ecb5d787875b451ab5318481d65fa2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:04.044360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-32a643f1-b341-4274-a195-05678a66016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:04.111082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1066/2113] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:04.123943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:04.177199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8c7a-5caf-4f30-91ef-0362e42ebfd7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:04.180921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:04.181564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:04.181870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:04.182161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:04.192438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:04.193882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:04.203164 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1048/2114] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:04.276966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a643f1-b341-4274-a195-05678a66016b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:04.287818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a643f1-b341-4274-a195-05678a66016b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:04.291883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:04.292583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:04.292862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:04.293164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:04.350541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:04.351988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:04.360681 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1067/2115] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:04.824080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:04.826206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:04.839333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1d55-1374-44a0-9e85-047500d7fef5 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:04.843443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:04.844088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:04.844372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:04.844654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:04.847732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:04.913305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:04.914965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667ad3e-bf8c-4078-86a1-e4d80b38345c service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:04.945008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1049/2116] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:07.119274 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:07.120654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:07.188689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f6ff-cc93-4d3f-af23-0f37adab09d2 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:07.193505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:07.194441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:07.194730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:07.195011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] PATH_INFO: `/v3/users/2e07b4469c294d83a83687e00827789d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:07.196207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e07b4469c294d83a83687e00827789d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:07.198163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:07.243613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e07b4469c294d83a83687e00827789d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.250624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e07b4469c294d83a83687e00827789d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.263522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e07b4469c294d83a83687e00827789d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.264216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e07b4469c294d83a83687e00827789d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.272304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e07b4469c294d83a83687e00827789d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.278673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1068/2117] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:07 2022] DELETE /identity/v3/users/2e07b4469c294d83a83687e00827789d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:07.283262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:07.283791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:07.283890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:07.301061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:07.302277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:07.364031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1050/2118] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:07.370479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:07.372088 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:07.453153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5562-a407-4852-b6c3-ff37844c5af1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:07.457644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:07.458501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:07.458965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:07.459449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:07.470300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:07.471787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:07.489185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1069/2119] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:07.500818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:07.502719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:07.563709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd94b44-c255-4a99-9320-7ed60996eed1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:07.568362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:07.569021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:07.569310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:07.569590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:07.571512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:07.642139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:07.643854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:07.653234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1051/2120] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:07.800331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:07.802561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:07.828818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec80d1-a119-4ffc-8608-71a50e5119d3 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:07.842292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:07.843163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:07.843445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:07.843720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] PATH_INFO: `/v3/projects/6e13881085594e1297e6a5a1f0da5eca` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:07.844901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e13881085594e1297e6a5a1f0da5eca)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:07.846894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:07.893627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e13881085594e1297e6a5a1f0da5eca', 'request_id': 'req-44749e4d-841a-4669-936b-7791b172dbe6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.901558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e13881085594e1297e6a5a1f0da5eca', 'request_id': 'req-44749e4d-841a-4669-936b-7791b172dbe6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.909824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e13881085594e1297e6a5a1f0da5eca', 'request_id': 'req-44749e4d-841a-4669-936b-7791b172dbe6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.927246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] The token cache is being invalidate because project 6e13881085594e1297e6a5a1f0da5eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:07.928544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.929363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:07.931831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1070/2121] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:07 2022] DELETE /identity/v3/projects/6e13881085594e1297e6a5a1f0da5eca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:07.936030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:07.952191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5551ead-5dad-463c-80c1-bff1172657aa service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:08.018982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:08.019861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:08.020141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:08.020417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] PATH_INFO: `/v3/users/e8c845240e814cad837520949192abb0` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:08.021601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c845240e814cad837520949192abb0)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:08.023791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:08.073055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c845240e814cad837520949192abb0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.080376 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c845240e814cad837520949192abb0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.092516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c845240e814cad837520949192abb0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.093154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c845240e814cad837520949192abb0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.093758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c845240e814cad837520949192abb0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.106368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1052/2122] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:07 2022] DELETE /identity/v3/users/e8c845240e814cad837520949192abb0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:08.368391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:08.369822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:08.390957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44749e4d-841a-4669-936b-7791b172dbe6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:08.445247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:08.446136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:08.446418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:08.446687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] PATH_INFO: `/v3/projects/9e3e37c6d3084d9eb0b2df5609002e0d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:08.447851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3e37c6d3084d9eb0b2df5609002e0d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:08.449753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:08.499404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3e37c6d3084d9eb0b2df5609002e0d', 'request_id': 'req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.507074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3e37c6d3084d9eb0b2df5609002e0d', 'request_id': 'req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.513149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3e37c6d3084d9eb0b2df5609002e0d', 'request_id': 'req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.524162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] The token cache is being invalidate because project 9e3e37c6d3084d9eb0b2df5609002e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:08.524452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.525089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.526673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1071/2123] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:08 2022] DELETE /identity/v3/projects/9e3e37c6d3084d9eb0b2df5609002e0d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:08.530901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:08.532738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:08.545785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386a94-f908-4fa2-a968-ceaf4a2b8bf7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:08.600705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:08.601542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:08.601828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:08.602134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] PATH_INFO: `/v3/users/3dec7f31c9204f38983126d27285b188` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:08.603315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dec7f31c9204f38983126d27285b188)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:08.605216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:08.652549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dec7f31c9204f38983126d27285b188'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.661420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dec7f31c9204f38983126d27285b188'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.675917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dec7f31c9204f38983126d27285b188'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.676702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dec7f31c9204f38983126d27285b188'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.677337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5ad8fffe-7f39-49e9-9208-233f636a3b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dec7f31c9204f38983126d27285b188'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:08.691832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1053/2124] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:08 2022] DELETE /identity/v3/users/3dec7f31c9204f38983126d27285b188 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:08.965108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:08.966556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:08.981511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a49c6-58a7-49dd-92b9-2a5e94d469c5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.046201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.047068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.047346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.047617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] PATH_INFO: `/v3/projects/f1a4b4a5724148d487594e4eea1c3ede` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.049374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a4b4a5724148d487594e4eea1c3ede)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.051984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.098113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a4b4a5724148d487594e4eea1c3ede', 'request_id': 'req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:09.105102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a4b4a5724148d487594e4eea1c3ede', 'request_id': 'req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:09.111248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a4b4a5724148d487594e4eea1c3ede', 'request_id': 'req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:09.121322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] The token cache is being invalidate because project f1a4b4a5724148d487594e4eea1c3ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:09.121604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:09.122239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-aa11f6bf-a1e0-4cac-8156-5d121b4230a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:09.123748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1072/2125] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:08 2022] DELETE /identity/v3/projects/f1a4b4a5724148d487594e4eea1c3ede => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:09.130477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.130769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.131045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.148393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:09.149565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:09.208693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1054/2126] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:09.216956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.217245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.217525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.235384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:09.237109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:09.245124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1073/2127] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:09.249450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.259670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda585fc-1918-45f8-9d24-166cb0933342 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.264400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.265053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.265334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.265634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.266387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:09.266694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.268884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.280227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1055/2128] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:09.284978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.294001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967472-0267-43f2-a7ea-21d0b37bd0ca None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.298673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.299915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.300227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.300503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.301191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.303129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.327642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1074/2129] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:09.331953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.341699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf53b1-0cf4-4828-9571-dbd2982ee35b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.395994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.396579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.396857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.397127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.397806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.399761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.419278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1056/2130] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:09.423424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.433709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0056d-2bd1-4cea-99d1-6e932199e871 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.438676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.439338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.440249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.440530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.441288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.442950 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.453059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1075/2131] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:09.457593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.467311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c7102-445f-4afa-ae01-bde49700463a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.472155 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93aa78-721f-4c1e-8888-4e1f6fa24512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.472797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93aa78-721f-4c1e-8888-4e1f6fa24512 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.473081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93aa78-721f-4c1e-8888-4e1f6fa24512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.473359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93aa78-721f-4c1e-8888-4e1f6fa24512 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.474113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93aa78-721f-4c1e-8888-4e1f6fa24512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.475694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93aa78-721f-4c1e-8888-4e1f6fa24512 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.485213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1057/2132] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:09.489231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.498977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979264c1-85c4-4ccf-8260-98b0f07ffd52 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.504377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.505250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.505535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.505810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] PATH_INFO: `/v3/projects/bd5d03d94ede4df290b2ba5d09187de3/users/a8126ba9ba5649aa898685f20b342d6e/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.520414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5d03d94ede4df290b2ba5d09187de3, user_id=a8126ba9ba5649aa898685f20b342d6e, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.523118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.535318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1076/2133] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:09 2022] PUT /identity/v3/projects/bd5d03d94ede4df290b2ba5d09187de3/users/a8126ba9ba5649aa898685f20b342d6e/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:09.547343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.547799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.547910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.574169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] MFA Rules not processed for user `a8126ba9ba5649aa898685f20b342d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:09.575358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:09.636875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1058/2134] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:09.641372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.701713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e59b3-3143-4750-b5a7-0c7991a8ba34 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.706427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.707078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.707362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.707640 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.708318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.710261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.734026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1077/2135] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:09.738702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.748942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd2fc2-43d6-4946-9362-4b76e8652863 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.816446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.817112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.817397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.817677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.818431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.820433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.841279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1059/2136] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:09.845225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.856351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040c8f0-ee9b-4322-a674-7fe65e3dde4c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.860945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.862173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.862453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.862729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.863473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.865067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.875186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1078/2137] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:09.879603 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.889273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec742d50-7f39-4c06-bf07-0d41f30dca65 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.894412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a82fd-0924-4928-ac42-cfe92ac78d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.895062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a82fd-0924-4928-ac42-cfe92ac78d32 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.895367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a82fd-0924-4928-ac42-cfe92ac78d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.895664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a82fd-0924-4928-ac42-cfe92ac78d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.896378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a82fd-0924-4928-ac42-cfe92ac78d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.898008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a82fd-0924-4928-ac42-cfe92ac78d32 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.907513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1060/2138] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:09.911977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:09.921388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87395083-0da7-43dd-9df5-110b43d5f943 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:09.926081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:09.926948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.927228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.927501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] PATH_INFO: `/v3/projects/8bae224b6e6a4c2583f66db2170820c2/users/502c7ffa437b4173a8e4a785e27f2e00/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.942711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bae224b6e6a4c2583f66db2170820c2, user_id=502c7ffa437b4173a8e4a785e27f2e00, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:09.946123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:09.959413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1079/2139] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:09 2022] PUT /identity/v3/projects/8bae224b6e6a4c2583f66db2170820c2/users/502c7ffa437b4173a8e4a785e27f2e00/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:09.969476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:09.969843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:09.970231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:09.997372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] MFA Rules not processed for user `502c7ffa437b4173a8e4a785e27f2e00`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:09.998630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:10.073330 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1061/2140] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:10.086611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.149096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fdb14-2c94-42d3-8b3a-d8c56c51de97 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.153617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.154295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.154573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.154843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.155519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.157440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.182131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1080/2141] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:10 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:10.186222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.198038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59479-e1b6-4074-ae1f-5cea452a85a6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.251655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.252842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.253125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.253400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.254119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.256037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.276010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1062/2142] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:10 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:10.280382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.290636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cbb23-7e27-45ad-a72a-d9c1e03717fc admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.295203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.296009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.296294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.296617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.297357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.299294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.309893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1081/2143] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:10.314242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.324637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae0b33-0498-4c17-a457-0225ca6ef0f5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.329249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.330941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.331235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.331515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] PATH_INFO: `/v3/projects/d798965f379b422f9c2ffccd7f41ba53/users/421d6393db064cbfb8117c9cf882704e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.345866 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d798965f379b422f9c2ffccd7f41ba53, user_id=421d6393db064cbfb8117c9cf882704e, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.348667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.361643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1063/2144] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:10 2022] PUT /identity/v3/projects/d798965f379b422f9c2ffccd7f41ba53/users/421d6393db064cbfb8117c9cf882704e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:10.365427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.375084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9dd5c-072a-4c0c-af61-aa818e5fdcb9 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.429411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acaa67-0e05-4dce-aaca-09a565f0d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.430086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acaa67-0e05-4dce-aaca-09a565f0d23c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.430364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acaa67-0e05-4dce-aaca-09a565f0d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.430633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acaa67-0e05-4dce-aaca-09a565f0d23c admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.431342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acaa67-0e05-4dce-aaca-09a565f0d23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.432925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acaa67-0e05-4dce-aaca-09a565f0d23c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.443356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1082/2145] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:10.447462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.457738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e764ad-6edd-473b-b01f-7c9bf70fe68a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.462426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.463245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.468944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.468944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] PATH_INFO: `/v3/projects/d798965f379b422f9c2ffccd7f41ba53/users/421d6393db064cbfb8117c9cf882704e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.468944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d798965f379b422f9c2ffccd7f41ba53, user_id=421d6393db064cbfb8117c9cf882704e, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.468944 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.478467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1064/2146] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:10 2022] PUT /identity/v3/projects/d798965f379b422f9c2ffccd7f41ba53/users/421d6393db064cbfb8117c9cf882704e/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:10.489392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.489797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.490134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.520375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] MFA Rules not processed for user `421d6393db064cbfb8117c9cf882704e`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:10.521579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:10.588301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1083/2147] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:10.599939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:10.601701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:10.656855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e368b-4a76-4ede-a2ca-7ef213f23bb2 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:10.661052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:10.661756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:10.662064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:10.662343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:10.717779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:10.719153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:10.727861 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1065/2148] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:12.194776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:12.204180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a78e73-48d9-4d18-99e6-67b63f49faa1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:12.207899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:12.208540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:12.208819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:12.209092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:12.266647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:12.268061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:12.277456 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1084/2149] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:12.889554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:12.891062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:12.903083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f80d4f-9303-435d-b0b7-e5693b225f51 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:12.907403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f54ad-8457-4f66-adf0-1ba3d09c5208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:12.908683 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f54ad-8457-4f66-adf0-1ba3d09c5208 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:12.909421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f54ad-8457-4f66-adf0-1ba3d09c5208 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:12.909767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f54ad-8457-4f66-adf0-1ba3d09c5208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:12.920109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f54ad-8457-4f66-adf0-1ba3d09c5208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:12.921578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f54ad-8457-4f66-adf0-1ba3d09c5208 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:12.932132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1066/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:14.207167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:14.211945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:14.320617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72de06-3dba-4549-900f-cb716f884eb2 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:14.327519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:14.328773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:14.329107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:14.329438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] PATH_INFO: `/v3/users/bff4c66ef70848f18d7d10efc302e985` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:14.331523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff4c66ef70848f18d7d10efc302e985)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:14.335067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:14.392349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff4c66ef70848f18d7d10efc302e985'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:14.400378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff4c66ef70848f18d7d10efc302e985'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:14.416091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff4c66ef70848f18d7d10efc302e985'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:14.416838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff4c66ef70848f18d7d10efc302e985'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:14.423494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff4c66ef70848f18d7d10efc302e985'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:14.429324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1085/2151] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:14 2022] DELETE /identity/v3/users/bff4c66ef70848f18d7d10efc302e985 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:14.433874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:14.434454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:14.434454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:14.452809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:14.454044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:14.511835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1067/2152] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:14.522559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:14.523954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:14.585377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd228c-dcce-41d1-a2fe-2f9fa4328b77 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:14.589110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079ab8-056c-4cbb-b911-0d477de3702c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:14.589779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079ab8-056c-4cbb-b911-0d477de3702c service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:14.590093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079ab8-056c-4cbb-b911-0d477de3702c service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:14.590405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079ab8-056c-4cbb-b911-0d477de3702c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:14.600201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079ab8-056c-4cbb-b911-0d477de3702c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:14.601975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079ab8-056c-4cbb-b911-0d477de3702c service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:14.611036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1086/2153] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:14.873243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:14.881573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:14.902520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:14.903226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:14.903321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:14.926443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b8395-083a-433f-810d-d0f74da08cfd None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:14.928587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] MFA Rules not processed for user `6cb5f67687dc4e9892e8ddd5c0aca940`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:14.930063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:14.932747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:14.933715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:14.942317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:14.942952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] PATH_INFO: `/v3/projects/f33bda6601c0471c99d3bc2483fd1d88` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:14.954591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33bda6601c0471c99d3bc2483fd1d88)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:14.956942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:15.000953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1087/2154] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:15.020807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33bda6601c0471c99d3bc2483fd1d88', 'request_id': 'req-008c249e-291a-4b17-8cab-ebf325d4804a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.035881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33bda6601c0471c99d3bc2483fd1d88', 'request_id': 'req-008c249e-291a-4b17-8cab-ebf325d4804a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.043515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33bda6601c0471c99d3bc2483fd1d88', 'request_id': 'req-008c249e-291a-4b17-8cab-ebf325d4804a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.056994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] The token cache is being invalidate because project f33bda6601c0471c99d3bc2483fd1d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:15.057335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.058200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.067104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1068/2155] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:14 2022] DELETE /identity/v3/projects/f33bda6601c0471c99d3bc2483fd1d88 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:15.070075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:15.085472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ac31a-4f64-431f-885d-acfb4d9697c6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:15.160774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:15.161663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:15.161975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:15.162253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] PATH_INFO: `/v3/users/ecb5d787875b451ab5318481d65fa2ec` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:15.163564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb5d787875b451ab5318481d65fa2ec)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:15.165492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:15.230945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb5d787875b451ab5318481d65fa2ec'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.239156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb5d787875b451ab5318481d65fa2ec'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.252524 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb5d787875b451ab5318481d65fa2ec'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.253301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb5d787875b451ab5318481d65fa2ec'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.260687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-9938d29f-9bfe-43e5-9337-f5679fb9ebb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb5d787875b451ab5318481d65fa2ec'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.266478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1088/2156] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:15 2022] DELETE /identity/v3/users/ecb5d787875b451ab5318481d65fa2ec => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:15.621383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:15.623126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:15.638951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c249e-291a-4b17-8cab-ebf325d4804a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:15.728393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:15.729428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:15.729717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:15.730024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] PATH_INFO: `/v3/projects/76bf96176cbf4992a76501f0f9a81993` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:15.733346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bf96176cbf4992a76501f0f9a81993)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:15.735538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:15.802849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bf96176cbf4992a76501f0f9a81993', 'request_id': 'req-b277e553-f9ec-43ce-b816-5397a5fb2817'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.810903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bf96176cbf4992a76501f0f9a81993', 'request_id': 'req-b277e553-f9ec-43ce-b816-5397a5fb2817'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.819332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bf96176cbf4992a76501f0f9a81993', 'request_id': 'req-b277e553-f9ec-43ce-b816-5397a5fb2817'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.830694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] The token cache is being invalidate because project 76bf96176cbf4992a76501f0f9a81993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:15.831092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.831907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b277e553-f9ec-43ce-b816-5397a5fb2817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:15.833511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1069/2157] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:15 2022] DELETE /identity/v3/projects/76bf96176cbf4992a76501f0f9a81993 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:15.838669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:15.838970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:15.839383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:15.857782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:15.859032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:15.920901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1089/2158] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:15.929541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:15.929836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:15.930175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:15.957138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:15.958350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:15.966347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1070/2159] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:15.971112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:15.981156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a771f8-e333-40d3-a66e-c4a3f35e52a7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:15.987861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:15.988588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:15.988872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:15.989198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:15.990052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:15.990312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:15.992037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.006823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1090/2160] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:16.008037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.009723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.010803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.021482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8639-c0d8-4dbf-ab0c-a9c28967c109 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.023982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb12c3-7484-45ca-a77e-a6a96a808620 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.027054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.027717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.028003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.028291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.029077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.031384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.031842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.032622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.033321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.033763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] PATH_INFO: `/v3/users/3547c1a8203f488fb66c5cd7033d5252` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.035322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3547c1a8203f488fb66c5cd7033d5252)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.037752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.059230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1091/2161] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:16.063254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.094170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3547c1a8203f488fb66c5cd7033d5252'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.103267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3547c1a8203f488fb66c5cd7033d5252'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.115490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3547c1a8203f488fb66c5cd7033d5252'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.116215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3547c1a8203f488fb66c5cd7033d5252'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.116897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f785fbe9-88e4-47a0-a224-68d316421868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3547c1a8203f488fb66c5cd7033d5252'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.129525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1071/2162] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:16 2022] DELETE /identity/v3/users/3547c1a8203f488fb66c5cd7033d5252 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:16.132140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe530d47-f857-42c2-bfb6-ef103ffe1531 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.134019 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.134468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.134748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.152182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:16.153400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.188796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.189497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.189777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.190099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.190784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.192763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.216698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1072/2163] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:16.222142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1092/2164] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:16.227134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.228686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.229143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.231033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.242801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1d0d-c2d1-4745-9db3-93ba3e5f27c2 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.248441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.249197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.249706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.250186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.250921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.252850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.263850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1073/2165] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:16.267800 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.277567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83897d-902b-406f-a0b0-fca45fd9baa0 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.282338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.283520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.283803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.284080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.285438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.287144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.296258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e3643-e373-4094-8c5b-d7a23cf36cd7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.297488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1074/2166] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:16.301017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42807267-3a59-44d3-969b-6976742501d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.301674 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807267-3a59-44d3-969b-6976742501d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.301997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807267-3a59-44d3-969b-6976742501d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.302230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.302325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807267-3a59-44d3-969b-6976742501d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.311634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42807267-3a59-44d3-969b-6976742501d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.312297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357474c-0e3b-43ed-b612-1fd0afb26ff7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.313354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42807267-3a59-44d3-969b-6976742501d5 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.317659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.323236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.324236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.324738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] PATH_INFO: `/v3/projects/50d89522ee0b47cdb9115449f5912128/users/2164e9e830e44a5e963f5039bb39765f/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.330431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1093/2167] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:16.342679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d89522ee0b47cdb9115449f5912128, user_id=2164e9e830e44a5e963f5039bb39765f, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.345398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.359352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1075/2168] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:16 2022] PUT /identity/v3/projects/50d89522ee0b47cdb9115449f5912128/users/2164e9e830e44a5e963f5039bb39765f/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:16.370537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366487b-e060-4715-987f-120112361c53 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.370781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366487b-e060-4715-987f-120112361c53 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.371073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366487b-e060-4715-987f-120112361c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.401703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0366487b-e060-4715-987f-120112361c53 None None] MFA Rules not processed for user `2164e9e830e44a5e963f5039bb39765f`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:16.402959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0366487b-e060-4715-987f-120112361c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.469370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1094/2169] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:16.474730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.537536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc021b51-534c-4ac1-8448-c0851e56145f admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.542684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.543355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.543639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.543917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.544637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.546608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.575723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1076/2170] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:16.576918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366487b-e060-4715-987f-120112361c53 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.590160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366487b-e060-4715-987f-120112361c53 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.605104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.607036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.662759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.663434 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.663718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.663997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.664688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.666684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.673041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a5c7e-699b-4881-abb5-354c438d6eb7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.678961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.679836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.680145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.680403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] PATH_INFO: `/v3/projects/7e881e6d815e4626a38331b60c03675f` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.681587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e881e6d815e4626a38331b60c03675f)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.683653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.687119 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1095/2171] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:16.691873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.701286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e597-a40c-47a8-adbc-1436632a7c6c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.706956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.707621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.707883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.708156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.708871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.710778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.721820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1096/2172] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:16.725841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.731175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e881e6d815e4626a38331b60c03675f', 'request_id': 'req-7d173f78-f710-4ee0-9a41-10520981a16e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.735058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd578ec-9f0a-485f-9014-6e61889a69f6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.739254 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e881e6d815e4626a38331b60c03675f', 'request_id': 'req-7d173f78-f710-4ee0-9a41-10520981a16e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.745609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e881e6d815e4626a38331b60c03675f', 'request_id': 'req-7d173f78-f710-4ee0-9a41-10520981a16e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.756454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] The token cache is being invalidate because project 7e881e6d815e4626a38331b60c03675f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:16.756741 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.757395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.758969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1077/2173] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:16 2022] DELETE /identity/v3/projects/7e881e6d815e4626a38331b60c03675f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:16.762709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.764016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.792973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.793838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.794147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.794421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] PATH_INFO: `/v3/projects/cceab763ca514a2f8ed1e08271d00a20/users/992a3f3715b54ade9bfe23b9b34fde8c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.809454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cceab763ca514a2f8ed1e08271d00a20, user_id=992a3f3715b54ade9bfe23b9b34fde8c, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.812424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.829138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1097/2174] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:16 2022] PUT /identity/v3/projects/cceab763ca514a2f8ed1e08271d00a20/users/992a3f3715b54ade9bfe23b9b34fde8c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:16.834164 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.834514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173f78-f710-4ee0-9a41-10520981a16e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.835922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:16.903623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.904424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.904700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.904979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] PATH_INFO: `/v3/users/a25a411e9dfd46d991754e53feb11cc1` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.906203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25a411e9dfd46d991754e53feb11cc1)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.908628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.922676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d542dba-b06e-4b71-8cf0-ac645000ec32 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.928588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.929483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.929771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.930081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.930810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.932429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.944075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1098/2175] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:16.948380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:16.958742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bb87e-f3a2-4348-875f-f678eb97dc7b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:16.961315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25a411e9dfd46d991754e53feb11cc1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.963526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7f76b-c43a-4c15-8e0e-c0d15e5bddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:16.964410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f76b-c43a-4c15-8e0e-c0d15e5bddc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.964692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f76b-c43a-4c15-8e0e-c0d15e5bddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.964971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f76b-c43a-4c15-8e0e-c0d15e5bddc4 admin admin] PATH_INFO: `/v3/projects/cceab763ca514a2f8ed1e08271d00a20/users/992a3f3715b54ade9bfe23b9b34fde8c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.967195 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7f76b-c43a-4c15-8e0e-c0d15e5bddc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cceab763ca514a2f8ed1e08271d00a20, user_id=992a3f3715b54ade9bfe23b9b34fde8c, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:16.968626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25a411e9dfd46d991754e53feb11cc1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.970041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7f76b-c43a-4c15-8e0e-c0d15e5bddc4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:16.980749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1099/2176] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:16 2022] PUT /identity/v3/projects/cceab763ca514a2f8ed1e08271d00a20/users/992a3f3715b54ade9bfe23b9b34fde8c/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:16.981613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25a411e9dfd46d991754e53feb11cc1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.982320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25a411e9dfd46d991754e53feb11cc1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.982927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25a411e9dfd46d991754e53feb11cc1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:16.992201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:16.992491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:16.992765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:16.996368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1078/2177] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:16 2022] DELETE /identity/v3/users/a25a411e9dfd46d991754e53feb11cc1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:17.018505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] MFA Rules not processed for user `992a3f3715b54ade9bfe23b9b34fde8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:17.019707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.090441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1100/2178] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:17.102521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.103906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.164987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0363dac-3571-4b72-b770-98bf28a9fc3c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.172134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.172802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.173083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.173353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.184364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.185878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.197117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1079/2179] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:17.277614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.282909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.297504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cbfd-4414-4674-96d3-4aae31f8c219 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.302348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.303400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.303862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.305255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.306695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.307898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.309661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.386656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.388504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f77176-8ae8-4120-bd63-cd5ace0f5b94 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.396077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887f789-96ae-4b90-a5ae-ad089f3e9000 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.399133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1101/2180] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:17.405430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.406457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.406626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.406901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] PATH_INFO: `/v3/projects/efb5c5da31754625ac4b0c493c7f7dc5` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.408627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb5c5da31754625ac4b0c493c7f7dc5)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.410652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.460529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb5c5da31754625ac4b0c493c7f7dc5', 'request_id': 'req-28eef91b-e0df-4c95-ac59-70fc378f0396'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:17.469813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb5c5da31754625ac4b0c493c7f7dc5', 'request_id': 'req-28eef91b-e0df-4c95-ac59-70fc378f0396'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:17.477614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb5c5da31754625ac4b0c493c7f7dc5', 'request_id': 'req-28eef91b-e0df-4c95-ac59-70fc378f0396'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:17.490415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] The token cache is being invalidate because project efb5c5da31754625ac4b0c493c7f7dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:17.490774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:17.491526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-28eef91b-e0df-4c95-ac59-70fc378f0396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:17.494412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1080/2181] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:17 2022] DELETE /identity/v3/projects/efb5c5da31754625ac4b0c493c7f7dc5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:17.500469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.500763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.504176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.531545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:17.532931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.594557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1102/2182] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:17.604135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.604428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.604708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.622895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:17.624074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:17.632422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1081/2183] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:17.636536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.646379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8a5f-ee33-42e4-923f-b6db04d59e9b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.650894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.651531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.651808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.652084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.652786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:17.653087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.654735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.666047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1103/2184] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:17.670219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.679698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367817d5-79a1-40cb-93b2-8ad24d98050f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.684419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.685057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.685340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.685616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.686341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.688516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.714124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1082/2185] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:17.718185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.727688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5441d3-e2d2-4d82-9bb8-5e8ae8ab23fb admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.781325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.782017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.782296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.782568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.783718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.785631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.804873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1104/2186] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:17 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:17.808896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.820749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e460-1078-4d02-b03a-fd5196676206 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.825705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.826704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.827007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.827419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.828174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.830601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.842185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1083/2187] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:17.846413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.856367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d83f-3b6d-43b4-9a75-2115ac139a14 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.861541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd9447-dec3-4013-ac33-df060cb6ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.861951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9447-dec3-4013-ac33-df060cb6ae7a admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.862232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9447-dec3-4013-ac33-df060cb6ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.862503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9447-dec3-4013-ac33-df060cb6ae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.863214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd9447-dec3-4013-ac33-df060cb6ae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.864809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd9447-dec3-4013-ac33-df060cb6ae7a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.874448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1105/2188] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:17.879450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:17.889497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe600d-05df-4a32-bc97-ead909a0a60e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:17.895355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:17.896267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.896544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.896867 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] PATH_INFO: `/v3/projects/7e2bd0b7cfbd43898c106ed1ea374282/users/2efd9de3c52c41ff82c60be6697ce482/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.912790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2bd0b7cfbd43898c106ed1ea374282, user_id=2efd9de3c52c41ff82c60be6697ce482, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:17.915497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:17.941239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1084/2189] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:17 2022] PUT /identity/v3/projects/7e2bd0b7cfbd43898c106ed1ea374282/users/2efd9de3c52c41ff82c60be6697ce482/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:17.948086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:17.948322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:17.948596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:17.976440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] MFA Rules not processed for user `2efd9de3c52c41ff82c60be6697ce482`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:17.977729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:18.048028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1106/2190] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:18.063776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:18.066724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:18.133222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b5902-b96c-4c83-9caf-c6735f268eb7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:18.137770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a32b-d57e-4c95-8fe4-0f7db0782369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:18.138625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a32b-d57e-4c95-8fe4-0f7db0782369 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:18.138978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a32b-d57e-4c95-8fe4-0f7db0782369 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:18.139323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a32b-d57e-4c95-8fe4-0f7db0782369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:18.150121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a32b-d57e-4c95-8fe4-0f7db0782369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:18.151581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a32b-d57e-4c95-8fe4-0f7db0782369 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:18.162418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1085/2191] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:19.020763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:19.022303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:19.096063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971152f-efec-4040-9fcd-6d6738d75b40 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:19.100693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:19.101642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:19.101953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:19.102256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] PATH_INFO: `/v3/users/a8126ba9ba5649aa898685f20b342d6e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:19.103556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8126ba9ba5649aa898685f20b342d6e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:19.105651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:19.150799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8126ba9ba5649aa898685f20b342d6e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.158488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8126ba9ba5649aa898685f20b342d6e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.170086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8126ba9ba5649aa898685f20b342d6e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.170746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8126ba9ba5649aa898685f20b342d6e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.177760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8126ba9ba5649aa898685f20b342d6e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.183654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1107/2192] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:19 2022] DELETE /identity/v3/users/a8126ba9ba5649aa898685f20b342d6e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:19.188357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:19.188819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:19.188910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:19.206680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:19.207882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:19.276071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1086/2193] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:19.302774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:19.304299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:19.375285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92495e-f5a1-418c-9a6d-d27c519c495e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:19.382142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:19.384456 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:19.385440 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:19.385794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:19.398699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:19.400828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:19.413779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1108/2194] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:19.753792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:19.755408 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:19.775689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc895a59-61e4-4705-bf4e-e9129ca6873d None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:19.787728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:19.788631 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:19.788909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:19.789210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] PATH_INFO: `/v3/projects/bd5d03d94ede4df290b2ba5d09187de3` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:19.790495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5d03d94ede4df290b2ba5d09187de3)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:19.792505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:19.841708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5d03d94ede4df290b2ba5d09187de3', 'request_id': 'req-0795aa41-4ae4-4613-998a-bb303c813cfe'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.851092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5d03d94ede4df290b2ba5d09187de3', 'request_id': 'req-0795aa41-4ae4-4613-998a-bb303c813cfe'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.857460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5d03d94ede4df290b2ba5d09187de3', 'request_id': 'req-0795aa41-4ae4-4613-998a-bb303c813cfe'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.878289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] The token cache is being invalidate because project bd5d03d94ede4df290b2ba5d09187de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:19.878848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.879763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:19.882040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1087/2195] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:19 2022] DELETE /identity/v3/projects/bd5d03d94ede4df290b2ba5d09187de3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:19.886451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:19.898537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33faa-dac6-4fa3-b52c-b333bcffcdc9 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:19.957383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:19.958296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:19.958577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:19.958850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] PATH_INFO: `/v3/users/502c7ffa437b4173a8e4a785e27f2e00` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:19.960076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=502c7ffa437b4173a8e4a785e27f2e00)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:19.962050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:20.011868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502c7ffa437b4173a8e4a785e27f2e00'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.021077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502c7ffa437b4173a8e4a785e27f2e00'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.039854 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502c7ffa437b4173a8e4a785e27f2e00'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.041470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502c7ffa437b4173a8e4a785e27f2e00'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.050774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502c7ffa437b4173a8e4a785e27f2e00'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.057968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1109/2196] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:19 2022] DELETE /identity/v3/users/502c7ffa437b4173a8e4a785e27f2e00 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:20.358380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:20.359957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:20.395549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795aa41-4ae4-4613-998a-bb303c813cfe admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:20.461812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:20.462718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:20.463049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:20.463479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] PATH_INFO: `/v3/projects/8bae224b6e6a4c2583f66db2170820c2` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:20.464946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bae224b6e6a4c2583f66db2170820c2)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:20.466940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:20.529188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bae224b6e6a4c2583f66db2170820c2', 'request_id': 'req-41593d18-53de-4a1b-bd38-cf6c6e73a98a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.539367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bae224b6e6a4c2583f66db2170820c2', 'request_id': 'req-41593d18-53de-4a1b-bd38-cf6c6e73a98a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.550411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bae224b6e6a4c2583f66db2170820c2', 'request_id': 'req-41593d18-53de-4a1b-bd38-cf6c6e73a98a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.566460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] The token cache is being invalidate because project 8bae224b6e6a4c2583f66db2170820c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:20.566758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.568436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.572075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1088/2197] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:20 2022] DELETE /identity/v3/projects/8bae224b6e6a4c2583f66db2170820c2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:20.576714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:20.579011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:20.595008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7ee53-9314-414c-a737-ab43958fbbca admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:20.680653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:20.681919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:20.682355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:20.682781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] PATH_INFO: `/v3/users/421d6393db064cbfb8117c9cf882704e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:20.684684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421d6393db064cbfb8117c9cf882704e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:20.687077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:20.740812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421d6393db064cbfb8117c9cf882704e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.752098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421d6393db064cbfb8117c9cf882704e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.763887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421d6393db064cbfb8117c9cf882704e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.764511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421d6393db064cbfb8117c9cf882704e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.771031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7a14b614-71f7-4d4d-bdfd-c27c56ad2253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421d6393db064cbfb8117c9cf882704e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:20.776677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1110/2198] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:20 2022] DELETE /identity/v3/users/421d6393db064cbfb8117c9cf882704e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:21.038979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.040421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:21.053681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593d18-53de-4a1b-bd38-cf6c6e73a98a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.109280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.110321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.110457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.110744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] PATH_INFO: `/v3/projects/d798965f379b422f9c2ffccd7f41ba53` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.112122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d798965f379b422f9c2ffccd7f41ba53)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.114037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.160986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd798965f379b422f9c2ffccd7f41ba53', 'request_id': 'req-291649f2-8d7d-4eda-9fe0-ab5347bf8448'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:21.168378 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd798965f379b422f9c2ffccd7f41ba53', 'request_id': 'req-291649f2-8d7d-4eda-9fe0-ab5347bf8448'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:21.174918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd798965f379b422f9c2ffccd7f41ba53', 'request_id': 'req-291649f2-8d7d-4eda-9fe0-ab5347bf8448'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:21.184831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] The token cache is being invalidate because project d798965f379b422f9c2ffccd7f41ba53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:21.185118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:21.185750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-291649f2-8d7d-4eda-9fe0-ab5347bf8448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:21.187383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1089/2199] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:21 2022] DELETE /identity/v3/projects/d798965f379b422f9c2ffccd7f41ba53 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:21.192949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.193497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.193580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.211656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:21.212839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:21.271113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1111/2200] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:21.281532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.281744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.282051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.299889 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:21.301066 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:21.308702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1090/2201] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:21.313022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.323030 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8b64-2532-450a-a8d4-d5b188fbc46c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.327589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.328310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.328650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.328940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.330379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:21.330695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.332306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.343739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1112/2202] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:21.348027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.357356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3e3a-aff8-4cdd-ace4-b90767bc9efd None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.362058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.362709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.362996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.363280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.363965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.365915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.391203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1091/2203] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:21.395895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.405548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5760bd-7abb-4d5c-a7be-5240d3c4d1a1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.459906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.460565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.460846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.461145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.461819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.463795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.483493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1113/2204] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:21.487677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.498118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a32b15-6708-4db6-b21b-35206b3bef49 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.503311 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.503959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.504246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.504525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.505248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.506894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.517113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1092/2205] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:21.521713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.531368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09637-8689-490d-acf4-3197e9e2b6fe admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.536013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae27d-2ce4-4c29-b564-a536b0e68608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.536602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae27d-2ce4-4c29-b564-a536b0e68608 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.536883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae27d-2ce4-4c29-b564-a536b0e68608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.537157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae27d-2ce4-4c29-b564-a536b0e68608 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.537888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae27d-2ce4-4c29-b564-a536b0e68608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.539558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae27d-2ce4-4c29-b564-a536b0e68608 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.549417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1114/2206] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:21.553362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.563138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4c22-0589-4c3b-9379-542a413dd188 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.568358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.569223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.569503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.569780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] PATH_INFO: `/v3/projects/fb33d92776dd4bd48ee0ba7877a91bd9/users/c1940dca58a3449ebb974d4204c997aa/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.585100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb33d92776dd4bd48ee0ba7877a91bd9, user_id=c1940dca58a3449ebb974d4204c997aa, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.587922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.601435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1093/2207] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:21 2022] PUT /identity/v3/projects/fb33d92776dd4bd48ee0ba7877a91bd9/users/c1940dca58a3449ebb974d4204c997aa/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:21.611592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.611901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.612201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.638482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] MFA Rules not processed for user `c1940dca58a3449ebb974d4204c997aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:21.639713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:21.702605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1115/2208] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:21.707178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.913183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37dd7c-fa56-4bf9-a8fc-17daad405d42 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:21.917786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:21.918481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:21.918767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:21.919046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:21.919729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:21.921621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:21.949346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1094/2209] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:21.953425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:21.964222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc9a10-60c1-4017-a127-a36279c812ef None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.019534 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.020205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.020487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.020765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.021449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.023423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.042980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1116/2210] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:21 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:22.047138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.057539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d456f-870d-450e-a995-c3ae9aab0c6d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.062133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.063046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.063328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.063606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.064356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.065977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.075887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1095/2211] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:22.079846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.089473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9cc23-ddc3-44b9-a055-f2da1e88c505 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.094201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea05b-f3f9-45a6-83ab-ecec16fa0b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.094853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea05b-f3f9-45a6-83ab-ecec16fa0b38 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.095134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea05b-f3f9-45a6-83ab-ecec16fa0b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.095914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea05b-f3f9-45a6-83ab-ecec16fa0b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.096630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea05b-f3f9-45a6-83ab-ecec16fa0b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.098324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea05b-f3f9-45a6-83ab-ecec16fa0b38 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.108093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1117/2212] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:22.112693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.122328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1719-2928-43cd-a72d-2f9052a1609e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.126987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.127852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.128137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.128416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] PATH_INFO: `/v3/projects/db071858fbb349d68de008c43d4507a0/users/e3e9bef18d1d466290a0cb9915470d67/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.143001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db071858fbb349d68de008c43d4507a0, user_id=e3e9bef18d1d466290a0cb9915470d67, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.145665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.158552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1096/2213] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:22 2022] PUT /identity/v3/projects/db071858fbb349d68de008c43d4507a0/users/e3e9bef18d1d466290a0cb9915470d67/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:22.169531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.169818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.170128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.198742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] MFA Rules not processed for user `e3e9bef18d1d466290a0cb9915470d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:22.199951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:22.261526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1118/2214] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:22.266089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.326991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02c8c-cb6b-4392-a597-23a5302e110c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.332161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.332822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.333110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.333391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.334109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.336027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.361489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1097/2215] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:22.366062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.377319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98ee10-8b6d-40cb-bc99-36eb7ee266b5 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.438979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.439902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.440186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.440460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.441155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.443176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.463785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1119/2216] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:22 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:22.467648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.477777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1cfb-1f42-4f83-919e-842566421ac8 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.482411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.483062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.483340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.483612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.484322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.486460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.497266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1098/2217] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:22.501330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.512114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc363a-afd2-4c7a-9116-fa281bf36a41 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.516642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.517575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.517865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.518152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] PATH_INFO: `/v3/projects/503edab0c19c4b2898502397421aff22/users/70f9905f694a4e7aabcae403ffd8a7c0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.531932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] RBAC: Authorizing `identity:create_grant(project_id=503edab0c19c4b2898502397421aff22, user_id=70f9905f694a4e7aabcae403ffd8a7c0, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.534612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.547061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1120/2218] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:22 2022] PUT /identity/v3/projects/503edab0c19c4b2898502397421aff22/users/70f9905f694a4e7aabcae403ffd8a7c0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:22.551374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.561222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be567df1-1127-4204-a7ef-f0391259e0f9 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.621324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479d9ae-ecc1-4418-b4a2-0cabb93923a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.621932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479d9ae-ecc1-4418-b4a2-0cabb93923a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.622215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479d9ae-ecc1-4418-b4a2-0cabb93923a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.622489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479d9ae-ecc1-4418-b4a2-0cabb93923a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.623194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479d9ae-ecc1-4418-b4a2-0cabb93923a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.624772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479d9ae-ecc1-4418-b4a2-0cabb93923a8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.634707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1099/2219] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:22.638949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.648852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b21a2-92ac-4754-8d9c-cf0b017a440c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.653380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.654290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.654567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.654840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] PATH_INFO: `/v3/projects/503edab0c19c4b2898502397421aff22/users/70f9905f694a4e7aabcae403ffd8a7c0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.656767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=503edab0c19c4b2898502397421aff22, user_id=70f9905f694a4e7aabcae403ffd8a7c0, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.659588 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.669284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1121/2220] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:22 2022] PUT /identity/v3/projects/503edab0c19c4b2898502397421aff22/users/70f9905f694a4e7aabcae403ffd8a7c0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:22.680173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.680464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.680740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.707537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] MFA Rules not processed for user `70f9905f694a4e7aabcae403ffd8a7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:22.708730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:22.773697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1100/2221] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:22.786920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:22.788113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:22.850081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9492651-9f10-40b0-a72e-ee168f28fd3b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:22.853961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:22.854768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:22.855057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:22.855336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:22.920481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:22.921953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:22.931555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1122/2222] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:27.583315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:27.584723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:27.596826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0259a-4264-4577-85e5-2b1294e3a9e9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:27.600729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b013f4-47f1-45d1-a57f-afd819fd9063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:27.601471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b013f4-47f1-45d1-a57f-afd819fd9063 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:27.601756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b013f4-47f1-45d1-a57f-afd819fd9063 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:27.602062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b013f4-47f1-45d1-a57f-afd819fd9063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:27.623127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:27.624791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:27.662645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b013f4-47f1-45d1-a57f-afd819fd9063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:27.664136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b013f4-47f1-45d1-a57f-afd819fd9063 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:27.674549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1101/2223] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:27.692135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691dc9c-88c0-481b-9349-03a482fd6292 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:27.696659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:27.697534 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:27.697813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:27.698118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] PATH_INFO: `/v3/users/2efd9de3c52c41ff82c60be6697ce482` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:27.699378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efd9de3c52c41ff82c60be6697ce482)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:27.702589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:27.752386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efd9de3c52c41ff82c60be6697ce482'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:27.759137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efd9de3c52c41ff82c60be6697ce482'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:27.773341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efd9de3c52c41ff82c60be6697ce482'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:27.774669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efd9de3c52c41ff82c60be6697ce482'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:27.782071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efd9de3c52c41ff82c60be6697ce482'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:27.787970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1123/2224] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:27 2022] DELETE /identity/v3/users/2efd9de3c52c41ff82c60be6697ce482 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:27.792463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:27.792753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:27.793151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:27.811303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:27.812658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:27.873690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1102/2225] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:27.883907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:27.885386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:27.955699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425123eb-e92c-4e94-81ce-296191739780 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:27.960024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:27.960687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:27.960963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:27.961240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:27.974005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:27.975431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:27.987791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1124/2226] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:28.227942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.229448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.284131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.285671 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.298815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16813b60-de7e-4183-b0b6-3a45eaf04800 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.308434 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.311153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.311447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.311733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] PATH_INFO: `/v3/users/2db713a7db2e4608ba841fe74ed53e8d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.313306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db713a7db2e4608ba841fe74ed53e8d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.316511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.316720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03556ac-aab7-4a32-8c28-80bd6d975f2e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.320687 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.322426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.322701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.322976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.325503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.372354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db713a7db2e4608ba841fe74ed53e8d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.380412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db713a7db2e4608ba841fe74ed53e8d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.391945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.393364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db713a7db2e4608ba841fe74ed53e8d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.394081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db713a7db2e4608ba841fe74ed53e8d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.394221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.400852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-693ce735-802b-4cd9-8898-3925714f4969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db713a7db2e4608ba841fe74ed53e8d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.403879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1103/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:28.406613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.410728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1125/2228] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:28 2022] DELETE /identity/v3/users/2db713a7db2e4608ba841fe74ed53e8d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:28.411201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.412280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.412571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.412989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.422596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9f3c0-5485-4db5-a56a-f5d226c7e157 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.433634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:28.434872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.504782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.505840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.506299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.506799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] PATH_INFO: `/v3/projects/7e2bd0b7cfbd43898c106ed1ea374282` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.508113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2bd0b7cfbd43898c106ed1ea374282)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.509968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1126/2229] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:28.510844 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.520779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.522281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.574160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2bd0b7cfbd43898c106ed1ea374282', 'request_id': 'req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.587002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2bd0b7cfbd43898c106ed1ea374282', 'request_id': 'req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.592769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365519c-bac3-44e2-9d4c-9fd0aab0868c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.593942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2bd0b7cfbd43898c106ed1ea374282', 'request_id': 'req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.612736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] The token cache is being invalidate because project 7e2bd0b7cfbd43898c106ed1ea374282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:28.613285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.614069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b5a8ddc-c25f-4fef-a780-7bbffd2bd342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:28.615757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1104/2230] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:28 2022] DELETE /identity/v3/projects/7e2bd0b7cfbd43898c106ed1ea374282 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:28.620573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8c609-7ba8-493c-aff8-069d0c76ccce None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.620869 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8c609-7ba8-493c-aff8-069d0c76ccce None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.621188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8c609-7ba8-493c-aff8-069d0c76ccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.644018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-16d8c609-7ba8-493c-aff8-069d0c76ccce None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:28.645265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-16d8c609-7ba8-493c-aff8-069d0c76ccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.660396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.661071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.661425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.661806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.664212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.716752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1105/2231] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:28.726987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.727425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.727886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.753355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.755597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:28.756913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:28.758769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.767763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1106/2232] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:28.772060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1127/2233] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:28.773342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.783984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35be5cf-bdf1-4757-a375-3aba267436e6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.789161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.789897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.790179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.790453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.791197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:28.791528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.793128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.808098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1107/2234] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:52:28.813024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.823468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3861-929f-481e-81c7-6f97727f7525 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.829585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.830924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.831217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.831522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.832291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.834374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.865184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1128/2235] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:28 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:28.866380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.876538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f2b35-c0f9-490f-b189-68f429874ea3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.942281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.943312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.943419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.943654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.949816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.949816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:28.969913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1108/2236] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:28 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:28.972047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:28.983670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7671-924b-4179-8bf9-e6ec1f2b7dcd admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:28.989418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:28.990121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:28.990401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:28.990670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:28.991400 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:28.993032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.004708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1129/2237] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:29.008508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.019795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320c8f-68f9-4648-ab95-60439bffb053 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.024999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.025831 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.026382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.026493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.027173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.028873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.054218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1109/2238] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:29.056220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.070887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.077594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380b7c-8c8f-4d49-956b-84b4fe4706ed admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.078832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.087854 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600e87c-520e-45a2-aac1-973cc48238ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.088953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600e87c-520e-45a2-aac1-973cc48238ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.089633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600e87c-520e-45a2-aac1-973cc48238ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.089633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600e87c-520e-45a2-aac1-973cc48238ce admin admin] PATH_INFO: `/v3/projects/11c9f043bb3248928d90caabff545a23/users/fa7bd05d9d564b1289805209886a80be/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.107550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcef5e-ddc8-477d-8f71-69ef18b233fb admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.108111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600e87c-520e-45a2-aac1-973cc48238ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c9f043bb3248928d90caabff545a23, user_id=fa7bd05d9d564b1289805209886a80be, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.111034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600e87c-520e-45a2-aac1-973cc48238ce admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.113109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.114048 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.114333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.114783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] PATH_INFO: `/v3/projects/cae6cdd15ca0467e85c9d102d4930b48` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.116206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae6cdd15ca0467e85c9d102d4930b48)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.118248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.128449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1130/2239] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:29 2022] PUT /identity/v3/projects/11c9f043bb3248928d90caabff545a23/users/fa7bd05d9d564b1289805209886a80be/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:29.138720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.139139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.139510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.178113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] MFA Rules not processed for user `fa7bd05d9d564b1289805209886a80be`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:29.179335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.194034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae6cdd15ca0467e85c9d102d4930b48', 'request_id': 'req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:29.209139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae6cdd15ca0467e85c9d102d4930b48', 'request_id': 'req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:29.216111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae6cdd15ca0467e85c9d102d4930b48', 'request_id': 'req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:29.230109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] The token cache is being invalidate because project cae6cdd15ca0467e85c9d102d4930b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:29.230390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:29.231050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba18cad1-fb3b-4775-8741-3c6f7f8ebdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:29.232847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1110/2240] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:29 2022] DELETE /identity/v3/projects/cae6cdd15ca0467e85c9d102d4930b48 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:29.237842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5caf-b94c-42dd-85c3-42d4afba38f3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.238165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5caf-b94c-42dd-85c3-42d4afba38f3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.238456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5caf-b94c-42dd-85c3-42d4afba38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.256821 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-65ee5caf-b94c-42dd-85c3-42d4afba38f3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:29.258082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-65ee5caf-b94c-42dd-85c3-42d4afba38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.265914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1131/2241] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:29.273563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.274963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.322526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1111/2242] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:29.330718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.331142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.331438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.339201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813af618-662d-49e6-a41a-ec82678fa2e3 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.343734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.344413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.345749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.346110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.354714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:29.356045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.357038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.358816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.370311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1132/2243] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:29.370605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1112/2244] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:29.371397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.384528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb912cc-e4fb-4612-849a-a534a3f4b6ca service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.389263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.389942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.390225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.390504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.391396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:29.391709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.394063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.406527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1133/2245] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:29.411961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.422533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2312810-1eb6-4054-8d8b-9c8d8f9b1c2e None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.433101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.434001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.434509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.434989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.436443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.439108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.469846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1113/2246] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:29 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:29.474427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.486585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a266ef-b359-40b5-9ba3-591c6e6b8fe8 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.551168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.551849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.552131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.552408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.553159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.555366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.578735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1134/2247] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:29 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:29.582881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.599437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6eb5e-f172-4460-b658-e3edb2aeea0d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.605727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.606512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.606978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.607335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.608258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.609840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.621996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1114/2248] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:29.626027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.638347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c27b2e-3ea2-4999-8b93-2b26e9e5f2e5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.648572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5147f-459a-447e-b2dd-8bf338de2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.648572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5147f-459a-447e-b2dd-8bf338de2bdb admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.648572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5147f-459a-447e-b2dd-8bf338de2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.648572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5147f-459a-447e-b2dd-8bf338de2bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.648923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5147f-459a-447e-b2dd-8bf338de2bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.649007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5147f-459a-447e-b2dd-8bf338de2bdb admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.661429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1135/2249] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:29.665477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.677510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a708b7-c510-408b-893c-a3ec6d18da5a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:29.691197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:29.692099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.692382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.692655 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] PATH_INFO: `/v3/projects/56a50db804764d59940834e6120f54b0/users/5006a5849bc94c17bd34f0dbf84c8351/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.728879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a50db804764d59940834e6120f54b0, user_id=5006a5849bc94c17bd34f0dbf84c8351, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:29.732425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:29.753890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1115/2250] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:29 2022] PUT /identity/v3/projects/56a50db804764d59940834e6120f54b0/users/5006a5849bc94c17bd34f0dbf84c8351/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:29.764516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:29.764898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:29.765130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:29.804420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] MFA Rules not processed for user `5006a5849bc94c17bd34f0dbf84c8351`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:29.806455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.919643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1136/2251] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:29.933411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.938018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:29.993697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:29.995142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:30.002588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1113ee-7775-4e24-88eb-1edacaf3992b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:30.006347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb939c2-74a5-4ca8-898b-cbd93eb5de24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:30.006956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb939c2-74a5-4ca8-898b-cbd93eb5de24 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:30.007244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb939c2-74a5-4ca8-898b-cbd93eb5de24 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:30.007586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb939c2-74a5-4ca8-898b-cbd93eb5de24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:30.015735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb939c2-74a5-4ca8-898b-cbd93eb5de24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:30.017204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb939c2-74a5-4ca8-898b-cbd93eb5de24 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:30.026435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1116/2252] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:30.070444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe012c-6f47-416e-8970-7a1810c8c555 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:30.075058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:30.075927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:30.076229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:30.076496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] PATH_INFO: `/v3/users/2164e9e830e44a5e963f5039bb39765f` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:30.077683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2164e9e830e44a5e963f5039bb39765f)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:30.079812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:30.125584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2164e9e830e44a5e963f5039bb39765f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.135131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2164e9e830e44a5e963f5039bb39765f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.147917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2164e9e830e44a5e963f5039bb39765f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.148765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2164e9e830e44a5e963f5039bb39765f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.155683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2164e9e830e44a5e963f5039bb39765f'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.162800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1137/2253] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:29 2022] DELETE /identity/v3/users/2164e9e830e44a5e963f5039bb39765f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:30.167455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:30.167904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:30.168201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:30.187805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:30.189191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:30.258843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1117/2254] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:30.276219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:30.277697 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:30.357796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84ca5d-d8a0-4170-a5a3-fcd080b2e15d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:30.369220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:30.369911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:30.370196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:30.370470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:30.379864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:30.381238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:30.392173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1138/2255] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:30.733158 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:30.734735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:30.747385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793a369-23c3-4947-a01d-8935fcc3edc0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:30.760188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:30.761146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:30.761605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:30.761907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] PATH_INFO: `/v3/projects/50d89522ee0b47cdb9115449f5912128` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:30.772969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d89522ee0b47cdb9115449f5912128)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:30.774566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:30.824905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d89522ee0b47cdb9115449f5912128', 'request_id': 'req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.832702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d89522ee0b47cdb9115449f5912128', 'request_id': 'req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.838956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d89522ee0b47cdb9115449f5912128', 'request_id': 'req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.853936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] The token cache is being invalidate because project 50d89522ee0b47cdb9115449f5912128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:30.854233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.854878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.856580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1118/2256] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:30 2022] DELETE /identity/v3/projects/50d89522ee0b47cdb9115449f5912128 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:30.860343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:30.871072 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2addb-c5fc-4672-aa60-52ec1d53a28d service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:30.935603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:30.936523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:30.936809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:30.937668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] PATH_INFO: `/v3/users/992a3f3715b54ade9bfe23b9b34fde8c` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:30.939340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=992a3f3715b54ade9bfe23b9b34fde8c)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:30.942090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:30.989635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992a3f3715b54ade9bfe23b9b34fde8c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:30.996912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992a3f3715b54ade9bfe23b9b34fde8c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.010096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992a3f3715b54ade9bfe23b9b34fde8c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.010765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992a3f3715b54ade9bfe23b9b34fde8c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.019126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-08385249-6557-4ef8-b783-842bd8920fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992a3f3715b54ade9bfe23b9b34fde8c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.025439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1139/2257] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:30 2022] DELETE /identity/v3/users/992a3f3715b54ade9bfe23b9b34fde8c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:31.324686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.326050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:31.348671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a36d8-bbc3-41c1-ada7-0bd07ec623d8 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:31.445196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:31.446365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.446852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.447240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] PATH_INFO: `/v3/projects/cceab763ca514a2f8ed1e08271d00a20` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.448765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cceab763ca514a2f8ed1e08271d00a20)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:31.459924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:31.539627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cceab763ca514a2f8ed1e08271d00a20', 'request_id': 'req-3868f143-c80b-4b50-b054-451f89bc2903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.550167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cceab763ca514a2f8ed1e08271d00a20', 'request_id': 'req-3868f143-c80b-4b50-b054-451f89bc2903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.560094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cceab763ca514a2f8ed1e08271d00a20', 'request_id': 'req-3868f143-c80b-4b50-b054-451f89bc2903'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.583984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] The token cache is being invalidate because project cceab763ca514a2f8ed1e08271d00a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:31.584344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.585429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3868f143-c80b-4b50-b054-451f89bc2903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:31.587229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1119/2258] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:31 2022] DELETE /identity/v3/projects/cceab763ca514a2f8ed1e08271d00a20 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:31.593006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.593286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.593566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.612461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:31.613660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:31.683921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1140/2259] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:31.685300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.685592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.685892 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.711237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:31.712530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:31.721306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1120/2260] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:31.725607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.734973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532eb56-842d-45fc-b5d8-36f8b332c2e1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:31.739764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:31.740416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.740693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.741081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.741794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:31.742129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:31.743713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:31.755841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1141/2261] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:31.760084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.769686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaf968-0b4a-4e32-b868-4ea2a74d75df None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:31.783165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:31.783828 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.784112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.784384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.785526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:31.787749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:31.823578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1121/2262] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:31 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:31.825256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.836127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc980-4bcd-4b6d-94b4-d49981523f28 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:31.911214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:31.912001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.912311 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.912586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.913289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:31.915240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:31.938112 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1142/2263] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:31 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:31.944059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.960579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c25a8-b635-4e15-985d-b35214168255 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:31.972153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:31.973021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.973407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.973783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:31.974009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.974819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:31.975714 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:31.976928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:31.993007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1122/2264] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:31.993382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac921a-44b7-4e41-b6a9-5cba36ce129b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:31.993720 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:31.998284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:31.999241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:31.999612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:31.999946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] PATH_INFO: `/v3/users/fa7bd05d9d564b1289805209886a80be` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.003221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7bd05d9d564b1289805209886a80be)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.003748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2be1af-6618-4bad-8022-d182d26f6672 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.005170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.009139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.010570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.010943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.012236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.013161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.015189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.027772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1123/2265] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:32.033891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.046095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09deb93-3524-4dfa-8caa-9d502357cd79 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.051082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823182-abd3-4baa-a2fc-91eebc911a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.051940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823182-abd3-4baa-a2fc-91eebc911a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.052217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823182-abd3-4baa-a2fc-91eebc911a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.052486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823182-abd3-4baa-a2fc-91eebc911a93 admin admin] PATH_INFO: `/v3/projects/c6b94874fac0457c8768bf8b9290ac02/users/48bfdec321c842b092a04af05b0a5eef/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.057279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7bd05d9d564b1289805209886a80be'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.065451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7bd05d9d564b1289805209886a80be'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.068626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823182-abd3-4baa-a2fc-91eebc911a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b94874fac0457c8768bf8b9290ac02, user_id=48bfdec321c842b092a04af05b0a5eef, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.071389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823182-abd3-4baa-a2fc-91eebc911a93 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.077270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7bd05d9d564b1289805209886a80be'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.077982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7bd05d9d564b1289805209886a80be'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.084709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1124/2266] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:32 2022] PUT /identity/v3/projects/c6b94874fac0457c8768bf8b9290ac02/users/48bfdec321c842b092a04af05b0a5eef/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:32.084931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d8a67155-be13-4562-a9b2-d71a52c7c313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7bd05d9d564b1289805209886a80be'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.092344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1143/2267] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:31 2022] DELETE /identity/v3/users/fa7bd05d9d564b1289805209886a80be => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:32.094784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.095613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.095890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.096546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.096925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.097205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.114945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:32.116148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.123136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] MFA Rules not processed for user `48bfdec321c842b092a04af05b0a5eef`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:32.124290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.174160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1144/2268] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:32.183614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.184939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.189372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1125/2269] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:32.193718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.195167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.207967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41c4b-96c1-48fc-a601-6dd41507ef2a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.212498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.213137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.213413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.213685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.214387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.216271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.242436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1126/2270] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:32.242647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8627e-bbac-4e38-937c-a9ecd91637c6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.246444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.290581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.291222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.291549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.291880 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.307373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798617d6-44e9-465f-ba6c-359705689e26 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.313469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.314726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.315005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.315271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.315947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.317842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.337325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1127/2271] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:32.341268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.352274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b32e0-0d4b-45b5-9cd6-107c9c41c05a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.353386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.354908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.357185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.357836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.358188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.358465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.359178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.361295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.365729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1145/2272] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:32.377547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1128/2273] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:32.383251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.394076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12accc-fecd-465d-b453-38090aefcd1e service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.398731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.399616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.399960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.400247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] PATH_INFO: `/v3/projects/426dc558915e4d50965fa31aceae254c/users/50b99ec6c3154e3ea3204d98da0edee0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.416554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426dc558915e4d50965fa31aceae254c, user_id=50b99ec6c3154e3ea3204d98da0edee0, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.417291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.419085 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.419811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.433437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00407c1-4984-43b8-b42e-39bfeaa74e57 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.435986 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1146/2274] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:32 2022] PUT /identity/v3/projects/426dc558915e4d50965fa31aceae254c/users/50b99ec6c3154e3ea3204d98da0edee0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:32.441766 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.499280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.502039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.502716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.503214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] PATH_INFO: `/v3/users/c1940dca58a3449ebb974d4204c997aa` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.504664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1940dca58a3449ebb974d4204c997aa)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.507145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.516565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8b820-66a3-4372-b12a-ace24c5b9c18 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.522913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.523669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.524154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.524279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.525265 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.531836 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.544789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1147/2275] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:32.551424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.563057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa87e3-0d76-4279-ba9a-4e7f0b76dc51 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.565045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1940dca58a3449ebb974d4204c997aa'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.568566 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153db78-3f5e-4544-aa84-734c694f184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.569827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153db78-3f5e-4544-aa84-734c694f184f admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.570172 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153db78-3f5e-4544-aa84-734c694f184f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.570575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153db78-3f5e-4544-aa84-734c694f184f admin admin] PATH_INFO: `/v3/projects/426dc558915e4d50965fa31aceae254c/users/50b99ec6c3154e3ea3204d98da0edee0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.573330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153db78-3f5e-4544-aa84-734c694f184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=426dc558915e4d50965fa31aceae254c, user_id=50b99ec6c3154e3ea3204d98da0edee0, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.574337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1940dca58a3449ebb974d4204c997aa'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.576613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153db78-3f5e-4544-aa84-734c694f184f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.588495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1148/2276] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:32 2022] PUT /identity/v3/projects/426dc558915e4d50965fa31aceae254c/users/50b99ec6c3154e3ea3204d98da0edee0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:32.589043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1940dca58a3449ebb974d4204c997aa'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.589810 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1940dca58a3449ebb974d4204c997aa'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.590442 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9a34a380-a010-4881-9f3b-cb80993a7011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1940dca58a3449ebb974d4204c997aa'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.600346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.600656 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.600959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.604948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1129/2277] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:32 2022] DELETE /identity/v3/users/c1940dca58a3449ebb974d4204c997aa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:32.610127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.611213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.611608 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.632152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] MFA Rules not processed for user `50b99ec6c3154e3ea3204d98da0edee0`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:32.632464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:32.633528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.633690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.714357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1130/2278] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:32.715488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.716897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.718367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1149/2279] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:32.725289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.726960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.738388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058170e7-41fb-4161-8348-17e3f4f8f819 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.743811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.744794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.745275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.745616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] PATH_INFO: `/v3/projects/11c9f043bb3248928d90caabff545a23` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.747353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c9f043bb3248928d90caabff545a23)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.749179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.789666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea253-2bf1-4042-abe5-0d9d0bb85835 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.810494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c9f043bb3248928d90caabff545a23', 'request_id': 'req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.819998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c9f043bb3248928d90caabff545a23', 'request_id': 'req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.827833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c9f043bb3248928d90caabff545a23', 'request_id': 'req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.839620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] The token cache is being invalidate because project 11c9f043bb3248928d90caabff545a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:32.839910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.840656 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:32.842233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1131/2280] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:32 2022] DELETE /identity/v3/projects/11c9f043bb3248928d90caabff545a23 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:32.842994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:32.844249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.847678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.848411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.849163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.849163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.851135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.914422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0d1f-c730-49ee-b78f-a2459b4e7295 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:32.918153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:32.918870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.919216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.919561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.921465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.927352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:32.928870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e7a92-32fe-405b-9d88-f3b746c6401c service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:32.939998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1150/2281] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:32.941682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25004ec5-3e09-4d57-8df3-e232e3e3ef7b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.941682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25004ec5-3e09-4d57-8df3-e232e3e3ef7b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.941998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25004ec5-3e09-4d57-8df3-e232e3e3ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:32.962200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-25004ec5-3e09-4d57-8df3-e232e3e3ef7b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:32.963590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-25004ec5-3e09-4d57-8df3-e232e3e3ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:32.973382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1151/2282] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:32.980872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:32.981150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:32.982357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.014692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:33.017259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.032872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.034667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.041891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1152/2283] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:33.044731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.046644 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1132/2284] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:33.082868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae898-e776-4cb0-9a90-ab1ecdc8a671 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.094299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.095149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.095527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.095901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.096713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:33.097954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.103709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.123253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1153/2285] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:33.128291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.142381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3ba6b-947c-4be2-b25f-f91cb7c1e428 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.148616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.149391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.149774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.150182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.150986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.153048 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.163527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.177550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd63ea-8c16-45f1-8bad-f0b52d20b3d1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.182644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.183555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.183994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.184450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.187095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.208983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1133/2286] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:33 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:33.213845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.276882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.284623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.303918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1154/2287] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:33.334845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b1ac2-6402-4fcf-b890-2034775dabb5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.342065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.342065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.342065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.342065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.344237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.347017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.377946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1134/2288] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:33 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:33.380199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.396597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229549d-0da7-4616-91ec-f1b312c99751 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.402166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.403046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.403539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.403835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.404819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.413284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.415339 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.417780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.436955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1155/2289] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:33.442940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b7457-bc8f-4823-bc02-4e1693f7d1f7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.446638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.459095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.460112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.460427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.460750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] PATH_INFO: `/v3/projects/fb33d92776dd4bd48ee0ba7877a91bd9` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.461196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eab3b-4b95-45f4-bf91-50a67e329699 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.462161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb33d92776dd4bd48ee0ba7877a91bd9)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.464355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.466963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.467777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.467881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.468209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.468924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.471434 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.484602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1156/2290] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:33.490099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.501202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b57b-9516-4bab-99a3-7f51a33945f3 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.507527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b784b-c561-4dbf-b0b0-3c00021ab015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.508695 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b784b-c561-4dbf-b0b0-3c00021ab015 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.509010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b784b-c561-4dbf-b0b0-3c00021ab015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.509408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b784b-c561-4dbf-b0b0-3c00021ab015 admin admin] PATH_INFO: `/v3/projects/3d53fd1057c44dffb358b098d5f190fa/users/6d080fb7bd6049dea53fe1912d46b11b/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.527351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb33d92776dd4bd48ee0ba7877a91bd9', 'request_id': 'req-eb682815-608b-4437-ba3a-596be730c7f7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.528099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b784b-c561-4dbf-b0b0-3c00021ab015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d53fd1057c44dffb358b098d5f190fa, user_id=6d080fb7bd6049dea53fe1912d46b11b, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.530997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b784b-c561-4dbf-b0b0-3c00021ab015 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.537519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb33d92776dd4bd48ee0ba7877a91bd9', 'request_id': 'req-eb682815-608b-4437-ba3a-596be730c7f7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.546990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1157/2291] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:33 2022] PUT /identity/v3/projects/3d53fd1057c44dffb358b098d5f190fa/users/6d080fb7bd6049dea53fe1912d46b11b/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:33.552106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb33d92776dd4bd48ee0ba7877a91bd9', 'request_id': 'req-eb682815-608b-4437-ba3a-596be730c7f7'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.553464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.553824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.554208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.563068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] The token cache is being invalidate because project fb33d92776dd4bd48ee0ba7877a91bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:33.563365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.564678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.566401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1135/2292] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:33 2022] DELETE /identity/v3/projects/fb33d92776dd4bd48ee0ba7877a91bd9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:33.570188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.571534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.574200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:33.575824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.641241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1158/2293] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:33.643138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.643598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682815-608b-4437-ba3a-596be730c7f7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.644742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.648371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.649249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.649533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.649808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] PATH_INFO: `/v3/users/e3e9bef18d1d466290a0cb9915470d67` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.651248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e9bef18d1d466290a0cb9915470d67)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.653167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.658824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0af835-9b37-4e15-b731-5f2bf57c2bc6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.664216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.665256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.665551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.665938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] PATH_INFO: `/v3/users/48bfdec321c842b092a04af05b0a5eef` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.667290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bfdec321c842b092a04af05b0a5eef)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.669453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.702351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e9bef18d1d466290a0cb9915470d67'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.711421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e9bef18d1d466290a0cb9915470d67'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.718676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bfdec321c842b092a04af05b0a5eef'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.725190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e9bef18d1d466290a0cb9915470d67'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.725786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e9bef18d1d466290a0cb9915470d67'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.726438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e9bef18d1d466290a0cb9915470d67'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.726856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bfdec321c842b092a04af05b0a5eef'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.738927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1136/2294] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:33 2022] DELETE /identity/v3/users/e3e9bef18d1d466290a0cb9915470d67 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:33.739622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bfdec321c842b092a04af05b0a5eef'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.739870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.740660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bfdec321c842b092a04af05b0a5eef'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.741206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.748551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-50f4c2f7-f0a1-4e78-aa3c-89601ee65801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bfdec321c842b092a04af05b0a5eef'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:33.755405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1159/2295] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:33 2022] DELETE /identity/v3/users/48bfdec321c842b092a04af05b0a5eef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:33.760022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.760349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.760664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.780360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:33.781928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.810500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dd6d8-d2bf-4d05-b3e1-4900ad13b4ac admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.850550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1160/2296] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:33.859969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:33.862029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.866457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.867301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.868027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.868027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.869823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:33.875862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b7cf3-671d-470b-ac03-572920c0d843 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:33.879761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:33.880385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:33.880666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:33.881505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:33.883217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.884654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.896837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1137/2297] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:33.897477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:33.899600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:33.912917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1161/2298] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:34.155098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:34.159363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:34.185709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50e5a-1d0e-4464-b279-bb5bbb79eea3 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:34.202530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:34.204481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:34.205077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:34.205829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] PATH_INFO: `/v3/projects/db071858fbb349d68de008c43d4507a0` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:34.209278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db071858fbb349d68de008c43d4507a0)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:34.214749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:34.306621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db071858fbb349d68de008c43d4507a0', 'request_id': 'req-f926f0de-b6fa-40de-84df-999de29c7478'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.330496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db071858fbb349d68de008c43d4507a0', 'request_id': 'req-f926f0de-b6fa-40de-84df-999de29c7478'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.342307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db071858fbb349d68de008c43d4507a0', 'request_id': 'req-f926f0de-b6fa-40de-84df-999de29c7478'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.369279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] The token cache is being invalidate because project db071858fbb349d68de008c43d4507a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:34.369710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.373366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.375167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1138/2299] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:34 2022] DELETE /identity/v3/projects/db071858fbb349d68de008c43d4507a0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:34.380570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:34.399751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9e87-f436-4a1d-a4f0-585ca5fe023f service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:34.556781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:34.559197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:34.567317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:34.568530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:34.568936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:34.569261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] PATH_INFO: `/v3/users/70f9905f694a4e7aabcae403ffd8a7c0` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:34.574843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f9905f694a4e7aabcae403ffd8a7c0)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:34.578046 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:34.609469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926f0de-b6fa-40de-84df-999de29c7478 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:34.617364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:34.618530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:34.619041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:34.619468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] PATH_INFO: `/v3/projects/c6b94874fac0457c8768bf8b9290ac02` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:34.620929 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b94874fac0457c8768bf8b9290ac02)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:34.623834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:34.693498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f9905f694a4e7aabcae403ffd8a7c0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.704557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f9905f694a4e7aabcae403ffd8a7c0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.724381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f9905f694a4e7aabcae403ffd8a7c0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.724864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b94874fac0457c8768bf8b9290ac02', 'request_id': 'req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.725403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f9905f694a4e7aabcae403ffd8a7c0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.734747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f9905f694a4e7aabcae403ffd8a7c0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.736549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b94874fac0457c8768bf8b9290ac02', 'request_id': 'req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.742512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1162/2300] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:34 2022] DELETE /identity/v3/users/70f9905f694a4e7aabcae403ffd8a7c0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:34.748274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b94874fac0457c8768bf8b9290ac02', 'request_id': 'req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.766489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] The token cache is being invalidate because project c6b94874fac0457c8768bf8b9290ac02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:34.766899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.770533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9f0d8f0-9287-4f9b-a85e-42539d6841e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:34.773534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1139/2301] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:34 2022] DELETE /identity/v3/projects/c6b94874fac0457c8768bf8b9290ac02 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:34.777892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:34.779359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:34.935413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d5a71-636a-43c8-8b10-ea6ce3a59539 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:34.963445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:34.965689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:34.967390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:34.968372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] PATH_INFO: `/v3/users/50b99ec6c3154e3ea3204d98da0edee0` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:34.973059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b99ec6c3154e3ea3204d98da0edee0)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:34.994937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:35.109920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.111407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.111975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.123794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b99ec6c3154e3ea3204d98da0edee0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.137158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b99ec6c3154e3ea3204d98da0edee0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.169692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] MFA Rules not processed for user `6d080fb7bd6049dea53fe1912d46b11b`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:35.172327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.186295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b99ec6c3154e3ea3204d98da0edee0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.187633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b99ec6c3154e3ea3204d98da0edee0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.201725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b99ec6c3154e3ea3204d98da0edee0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.215665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1163/2302] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:34 2022] DELETE /identity/v3/users/50b99ec6c3154e3ea3204d98da0edee0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:35.272975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:35.275384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.298633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1140/2303] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:35.310653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:35.313289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.397787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fa1c9-ae32-4080-abbe-57f2b373f904 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:35.404131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066a06-6ff2-4f17-976b-75c84957cfb2 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:35.410890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:35.411968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.412297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.412651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] PATH_INFO: `/v3/projects/503edab0c19c4b2898502397421aff22` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.414506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503edab0c19c4b2898502397421aff22)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:35.416733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:35.452391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:35.453059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.453668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.453668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.479776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503edab0c19c4b2898502397421aff22', 'request_id': 'req-7849c3f6-fbc9-457b-b9de-4673550da788'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.490479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503edab0c19c4b2898502397421aff22', 'request_id': 'req-7849c3f6-fbc9-457b-b9de-4673550da788'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.497279 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503edab0c19c4b2898502397421aff22', 'request_id': 'req-7849c3f6-fbc9-457b-b9de-4673550da788'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.513264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] The token cache is being invalidate because project 503edab0c19c4b2898502397421aff22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:35.513745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.519679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7849c3f6-fbc9-457b-b9de-4673550da788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.519679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1164/2304] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:35 2022] DELETE /identity/v3/projects/503edab0c19c4b2898502397421aff22 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:35.526290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854a16-0842-405a-abd2-065873db520a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.526887 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854a16-0842-405a-abd2-065873db520a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.527405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854a16-0842-405a-abd2-065873db520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.539884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:35.541568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:35.553521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1141/2305] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:35.555170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4e854a16-0842-405a-abd2-065873db520a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:35.557273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4e854a16-0842-405a-abd2-065873db520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.587219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:35.592568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.624852 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf3a4-4272-474d-957f-b784ee58e745 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:35.671430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1165/2306] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:35.681668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.684757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.685098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.702465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:35.703516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.703895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.705018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] PATH_INFO: `/v3/projects/426dc558915e4d50965fa31aceae254c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.709700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426dc558915e4d50965fa31aceae254c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:35.710037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:35.711401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.712107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:35.723178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1166/2307] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:35.727916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:35.744589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce9d71-86c2-4729-bbff-4e07d539e6b4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:35.750830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:35.752386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.753010 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.753491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.754457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:35.754838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:35.756881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:35.774600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1167/2308] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:35.777549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426dc558915e4d50965fa31aceae254c', 'request_id': 'req-a1e92415-4d78-4eca-b8b4-cddb856b3268'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.788386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:35.790968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426dc558915e4d50965fa31aceae254c', 'request_id': 'req-a1e92415-4d78-4eca-b8b4-cddb856b3268'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.810617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426dc558915e4d50965fa31aceae254c', 'request_id': 'req-a1e92415-4d78-4eca-b8b4-cddb856b3268'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.812179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] The token cache is being invalidate because project 426dc558915e4d50965fa31aceae254c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:35.812179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.813131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a1e92415-4d78-4eca-b8b4-cddb856b3268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:35.815577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1142/2309] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:35 2022] DELETE /identity/v3/projects/426dc558915e4d50965fa31aceae254c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:52:35.820793 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6619ee2-ee5d-4414-a0d3-e4a7fe51c4fb None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.821264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6619ee2-ee5d-4414-a0d3-e4a7fe51c4fb None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.821599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6619ee2-ee5d-4414-a0d3-e4a7fe51c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.824912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ec50-98fc-4abb-8286-a5c7366d2372 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:35.841792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c6619ee2-ee5d-4414-a0d3-e4a7fe51c4fb None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:35.843077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c6619ee2-ee5d-4414-a0d3-e4a7fe51c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.921267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:35.925058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.925742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.926368 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.931559 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1143/2310] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:35.940549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:35.940549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:35.941049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:35.941049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:35.941049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:35.983995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:35.987451 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:35.991465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1168/2311] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:35.995458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.000237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:36.098091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1144/2312] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:36.102703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.114312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635296b6-7406-44f6-8fd6-f9df29ba7f4b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.121352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.122514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.122850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.123198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.124204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:52:36.124724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.126562 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.137837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b254b-0e4e-4caa-8941-a8e98a3821b0 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.145081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1145/2313] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:52:36.145446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.146555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.146843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.146973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.147116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.147795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.149810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.157836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bb8ce-650f-4831-bfe0-0e2f7c10ceb4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.163060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.163773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.164131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.164356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.165115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.167044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.171062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1169/2314] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:35 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:52:36.175341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.187160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171cfa5-d65a-4b31-af78-00fdc8254934 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.192957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.193678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.194094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.194357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.195162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.197007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.200812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1146/2315] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:52:36 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:36.201601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.209063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1170/2316] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:36.212866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.224406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a3a3b-df5f-4ef5-81df-a8a3382636ae admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.264143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7be0-a91e-4697-afb0-2aef98d76680 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.269877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.270555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.270840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.271123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.271818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.273846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.290326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.290988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.291276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.291555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.292277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.293914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.297210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1147/2317] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:52:36 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:52:36.302838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.307505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1171/2318] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:36.308372 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.315757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848404c8-132f-415d-838f-6b83ec9cee70 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.319726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9ae42-996a-4a9a-8854-abb696572c8e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.321409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.322293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.322652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.322932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.323659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.324842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c2bc3-d9cd-4c2a-83ec-5027a7b7dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.325257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.325811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c2bc3-d9cd-4c2a-83ec-5027a7b7dc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.326130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c2bc3-d9cd-4c2a-83ec-5027a7b7dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.326574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c2bc3-d9cd-4c2a-83ec-5027a7b7dc28 admin admin] PATH_INFO: `/v3/projects/3625f5fbb36843cda1ec7fbfc12e8d7a/users/da4157ebc001411193f46461bebef4d9/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.339939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1148/2319] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:52:36.340989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.345882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c2bc3-d9cd-4c2a-83ec-5027a7b7dc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3625f5fbb36843cda1ec7fbfc12e8d7a, user_id=da4157ebc001411193f46461bebef4d9, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.348830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c2bc3-d9cd-4c2a-83ec-5027a7b7dc28 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.351128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe74ce-036b-4b6f-aa16-ea2e22c9a125 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.356619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.357394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.357838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.358215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.359135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.360881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.364924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1172/2320] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:36 2022] PUT /identity/v3/projects/3625f5fbb36843cda1ec7fbfc12e8d7a/users/da4157ebc001411193f46461bebef4d9/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:36.371259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1149/2321] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:52:36.378159 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.378881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.379221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.383357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.403847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed21ee5-197d-4e00-8fea-4cb2c35b9e91 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.409992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] MFA Rules not processed for user `da4157ebc001411193f46461bebef4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:36.411397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:36.468205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d96239-12c0-4911-ba5a-5ce0baf2ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.469258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d96239-12c0-4911-ba5a-5ce0baf2ec83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.469645 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d96239-12c0-4911-ba5a-5ce0baf2ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.470098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d96239-12c0-4911-ba5a-5ce0baf2ec83 admin admin] PATH_INFO: `/v3/projects/d635a33d30ea419698f82ab0fdb2d824/users/ebcea2b8ff8d439ca569c0b83cd5c02a/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.485244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1173/2322] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:36.487715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d96239-12c0-4911-ba5a-5ce0baf2ec83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d635a33d30ea419698f82ab0fdb2d824, user_id=ebcea2b8ff8d439ca569c0b83cd5c02a, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.491456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d96239-12c0-4911-ba5a-5ce0baf2ec83 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.504411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.505840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:36.506227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1150/2323] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:52:36 2022] PUT /identity/v3/projects/d635a33d30ea419698f82ab0fdb2d824/users/ebcea2b8ff8d439ca569c0b83cd5c02a/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:36.518580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.519116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.519521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.548881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] MFA Rules not processed for user `ebcea2b8ff8d439ca569c0b83cd5c02a`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:36.550128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:36.568371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442b1e3-94c3-4c3d-87c1-c6095422b49d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.611886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1151/2324] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:52:36.622003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.622975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.623208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.623463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.623764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.624615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:36.681638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e594c72-f593-4d53-8b08-124d6bffaa4b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.685239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27b167-8f66-4667-bb1e-2a4bf82d41dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.685916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27b167-8f66-4667-bb1e-2a4bf82d41dd service glance] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.686202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27b167-8f66-4667-bb1e-2a4bf82d41dd service glance] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.686477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27b167-8f66-4667-bb1e-2a4bf82d41dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.691864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.693350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.695870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27b167-8f66-4667-bb1e-2a4bf82d41dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.697293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27b167-8f66-4667-bb1e-2a4bf82d41dd service glance] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.702489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1174/2325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:36.707654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1152/2326] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:52:36.728206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:36.789984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0365f-2816-43dd-b600-ee807c12c70d service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:36.794940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:36.795812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.796095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.796366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] PATH_INFO: `/v3/users/da4157ebc001411193f46461bebef4d9` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.797627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4157ebc001411193f46461bebef4d9)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:36.800673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:36.850492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4157ebc001411193f46461bebef4d9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:36.858082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4157ebc001411193f46461bebef4d9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:36.871902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4157ebc001411193f46461bebef4d9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:36.872441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4157ebc001411193f46461bebef4d9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:36.879913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4157ebc001411193f46461bebef4d9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:36.886285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1175/2327] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:52:36 2022] DELETE /identity/v3/users/da4157ebc001411193f46461bebef4d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:36.891118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2825dc-ceb7-469b-84de-f5d1461afd41 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:36.891878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2825dc-ceb7-469b-84de-f5d1461afd41 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:36.892184 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2825dc-ceb7-469b-84de-f5d1461afd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:36.943327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-5a2825dc-ceb7-469b-84de-f5d1461afd41 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:36.944877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5a2825dc-ceb7-469b-84de-f5d1461afd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:37.017351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1153/2328] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:37.029975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:37.032805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:37.124746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da055f-ccb6-4333-b9e7-b9ef32f17d7e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:37.129787 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:37.130649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:37.130748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:37.131048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:37.143878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:37.146360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:37.162940 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1176/2329] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:52:37.312995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcb3b-fc93-4bb4-8001-9a5c4ca72dea None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:37.312995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcb3b-fc93-4bb4-8001-9a5c4ca72dea None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:37.312995 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcb3b-fc93-4bb4-8001-9a5c4ca72dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:37.338388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-588dcb3b-fc93-4bb4-8001-9a5c4ca72dea None None] MFA Rules not processed for user `6d080fb7bd6049dea53fe1912d46b11b`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:37.339814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-588dcb3b-fc93-4bb4-8001-9a5c4ca72dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:37.415072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1154/2330] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:52:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:37.770608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:37.772277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:37.794931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad39bf-768d-48e3-85d7-af97388c277a service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:37.809933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:37.810813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:37.811634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:37.811923 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] PATH_INFO: `/v3/projects/3625f5fbb36843cda1ec7fbfc12e8d7a` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:37.814273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3625f5fbb36843cda1ec7fbfc12e8d7a)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:37.817114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:37.878250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3625f5fbb36843cda1ec7fbfc12e8d7a', 'request_id': 'req-114e2d08-7fdf-4fff-9590-4250fe3cfec4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:37.889171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3625f5fbb36843cda1ec7fbfc12e8d7a', 'request_id': 'req-114e2d08-7fdf-4fff-9590-4250fe3cfec4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:37.896893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3625f5fbb36843cda1ec7fbfc12e8d7a', 'request_id': 'req-114e2d08-7fdf-4fff-9590-4250fe3cfec4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:37.912125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] The token cache is being invalidate because project 3625f5fbb36843cda1ec7fbfc12e8d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:52:37.912410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:37.913068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:52:37.925984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1177/2331] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:52:37 2022] DELETE /identity/v3/projects/3625f5fbb36843cda1ec7fbfc12e8d7a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:52:45.700648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:45.701057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:45.701315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:45.721811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:52:45.723256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:45.782236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1155/2332] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:52:45.833760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:52:45.835232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:52:45.919773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e2d08-7fdf-4fff-9590-4250fe3cfec4 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:52:45.924735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457e26f-6d31-4691-9669-2730be3fbae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:52:45.925379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457e26f-6d31-4691-9669-2730be3fbae1 service swift] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:52:45.925659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457e26f-6d31-4691-9669-2730be3fbae1 service swift] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:52:45.925962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457e26f-6d31-4691-9669-2730be3fbae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:52:45.934749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457e26f-6d31-4691-9669-2730be3fbae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:52:45.936386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457e26f-6d31-4691-9669-2730be3fbae1 service swift] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:52:45.953203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1178/2333] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:52:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:53:04.015297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:04.018166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:04.103165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002d58-b5ae-4486-908b-bc9a434d3763 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:04.108574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:04.109543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:04.109946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:04.110305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] PATH_INFO: `/v3/users/ebcea2b8ff8d439ca569c0b83cd5c02a` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:04.111610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcea2b8ff8d439ca569c0b83cd5c02a)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:04.113805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:04.171965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcea2b8ff8d439ca569c0b83cd5c02a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:04.182438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcea2b8ff8d439ca569c0b83cd5c02a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:04.201764 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcea2b8ff8d439ca569c0b83cd5c02a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:04.202636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcea2b8ff8d439ca569c0b83cd5c02a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:04.206481 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcea2b8ff8d439ca569c0b83cd5c02a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:04.222017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1156/2334] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:53:04 2022] DELETE /identity/v3/users/ebcea2b8ff8d439ca569c0b83cd5c02a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:04.226282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:04.227199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:04.227670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:04.246892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:04.248651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:04.362636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1179/2335] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:04.370900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:04.372738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:04.467994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f29ba4-c95b-4619-aa36-da2a195d7cd3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:04.472881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a84b-634e-42fe-898c-1760a8109c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:04.473544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a84b-634e-42fe-898c-1760a8109c79 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:04.473832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a84b-634e-42fe-898c-1760a8109c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:04.474161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a84b-634e-42fe-898c-1760a8109c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:04.490343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a84b-634e-42fe-898c-1760a8109c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:04.492795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a84b-634e-42fe-898c-1760a8109c79 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:04.505282 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1157/2336] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:04.926893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:04.928829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:04.946419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9654-2785-4b97-9411-ea925e0d4a5b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:04.955959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:04.956860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:04.957183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:04.958470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] PATH_INFO: `/v3/projects/d635a33d30ea419698f82ab0fdb2d824` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:04.959682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d635a33d30ea419698f82ab0fdb2d824)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:04.961608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.013609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd635a33d30ea419698f82ab0fdb2d824', 'request_id': 'req-5736d357-9e16-4918-b81b-8f078cfa4c15'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:05.021600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd635a33d30ea419698f82ab0fdb2d824', 'request_id': 'req-5736d357-9e16-4918-b81b-8f078cfa4c15'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:05.030179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd635a33d30ea419698f82ab0fdb2d824', 'request_id': 'req-5736d357-9e16-4918-b81b-8f078cfa4c15'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:05.042688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] The token cache is being invalidate because project d635a33d30ea419698f82ab0fdb2d824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:53:05.043019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:05.043663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5736d357-9e16-4918-b81b-8f078cfa4c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:05.049905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1180/2337] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:53:04 2022] DELETE /identity/v3/projects/d635a33d30ea419698f82ab0fdb2d824 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:05.051714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.052298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.052400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.071499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:05.072798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:05.139259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1158/2338] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:05.148082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.148370 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.148642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.167126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:05.168360 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:05.177732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1181/2339] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:53:05.182401 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.193620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9119-bf4c-40be-9ee1-34afa7423ba0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.199459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.200189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.200553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.200900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.201630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:53:05.201965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.203898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.223299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1159/2340] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:53:05.224437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.238938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47015d8c-dc11-4408-bef8-7d3842e1bd81 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.246228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.246931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.247214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.247496 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.248233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.251958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.301531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1182/2341] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:05 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:05.304911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.319502 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aea08-4b95-482d-a7cf-7922f318887d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.412679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.413993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.414490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.415058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.416313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.419865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.452411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1160/2342] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:05 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:05.461158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.477589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683dfad-d0fe-4ecc-925f-b3b83ba78ca1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.483442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.484390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.484707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.484988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.485757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.487801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.499493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1183/2343] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:05.504334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.516734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b0ff-6f50-4414-a9c1-9c1251217081 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.526131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6a91b-e146-4095-817f-c523ff85a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.527192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6a91b-e146-4095-817f-c523ff85a63c admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.527734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6a91b-e146-4095-817f-c523ff85a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.528221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6a91b-e146-4095-817f-c523ff85a63c admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.529252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6a91b-e146-4095-817f-c523ff85a63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.531237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6a91b-e146-4095-817f-c523ff85a63c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.546101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1161/2344] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:53:05.547003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.558015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df13d-0096-4c3d-9a66-cbbc1c7c2e8f admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.568423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.569338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.569602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.570430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] PATH_INFO: `/v3/projects/286a1f00d02f48869545622deea1eaf5/users/6a399626a25d499e8831a80aa1623f89/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.589804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286a1f00d02f48869545622deea1eaf5, user_id=6a399626a25d499e8831a80aa1623f89, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.593170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.627345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1184/2345] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:05 2022] PUT /identity/v3/projects/286a1f00d02f48869545622deea1eaf5/users/6a399626a25d499e8831a80aa1623f89/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:05.629358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13906731-2d3a-40de-ad3d-5191fcce8bdd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.629906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13906731-2d3a-40de-ad3d-5191fcce8bdd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.630025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13906731-2d3a-40de-ad3d-5191fcce8bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.673321 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-13906731-2d3a-40de-ad3d-5191fcce8bdd None None] MFA Rules not processed for user `6a399626a25d499e8831a80aa1623f89`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:05.675285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-13906731-2d3a-40de-ad3d-5191fcce8bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:05.807483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1162/2346] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:05.837935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:05.839568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:05.918861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69095864-ee9f-40a6-acb2-effa34377747 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:05.923859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:05.924777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:05.925054 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:05.925326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:05.936938 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:05.939526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:05.959472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1185/2347] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:17.798571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:17.799162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:17.799162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:17.820510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:17.821959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:17.889672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1163/2348] 10.222.0.30 () {58 vars in 967 bytes} [Tue Mar 8 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:17.904467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:17.906013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:17.976620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b08040-34c7-4a45-a53f-038a393ba4eb service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:17.981583 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:17.982270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:17.982579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:17.982854 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:17.991344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:17.992891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:18.001893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1186/2349] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:53:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:53:19.938662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:19.941070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:20.011110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec31707-d02b-419e-aaa5-150285b4aeb0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.017565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.018620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.018901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.019179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] PATH_INFO: `/v3/users/6cb5f67687dc4e9892e8ddd5c0aca940` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.020440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb5f67687dc4e9892e8ddd5c0aca940)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.023865 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.084476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb5f67687dc4e9892e8ddd5c0aca940'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.092954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb5f67687dc4e9892e8ddd5c0aca940'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.105337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb5f67687dc4e9892e8ddd5c0aca940'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.106030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb5f67687dc4e9892e8ddd5c0aca940'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.106628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-390efeb2-069a-40e2-9dd1-336f89a4fa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb5f67687dc4e9892e8ddd5c0aca940'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.119031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1164/2350] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:53:19 2022] DELETE /identity/v3/users/6cb5f67687dc4e9892e8ddd5c0aca940 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:20.295751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.315371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf35fc9-0990-41f3-9c7c-c5fbf4e533fa service swift] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.375486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.375877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.376149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.376417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] PATH_INFO: `/v3/projects/4c0e945e64844205b1df851fb73e1ea2` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.377629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0e945e64844205b1df851fb73e1ea2)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.379572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.427565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0e945e64844205b1df851fb73e1ea2', 'request_id': 'req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.434792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0e945e64844205b1df851fb73e1ea2', 'request_id': 'req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.441825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0e945e64844205b1df851fb73e1ea2', 'request_id': 'req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.451489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] The token cache is being invalidate because project 4c0e945e64844205b1df851fb73e1ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:53:20.451768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.452388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-882d7a5f-ac41-4157-8a7c-31d2259ceaa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:20.454894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1187/2351] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:53:20 2022] DELETE /identity/v3/projects/4c0e945e64844205b1df851fb73e1ea2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:20.459724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.460013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.460286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.478886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:20.480072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:20.538568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1165/2352] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:20.546093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.546446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.546717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.565619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:20.566925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:20.575183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1188/2353] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:20.580245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.590080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c1b5-ad9c-43be-9a24-f91472d64695 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.594843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.595495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.595773 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.596044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.596753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:53:20.597080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.598698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.613605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1166/2354] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:53:20.614798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.623962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f3b19-774c-4f39-a174-e04a7248c2a7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.629113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.629804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.630138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.630415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.631093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.633025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.658105 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1189/2355] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:20 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:20.662224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.672276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92413e92-f8c1-4d59-a357-4958dbe6217c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.729394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.730099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.730380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.730651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.731375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.733284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.778162 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1167/2356] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:20 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:20.779712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.812728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24845df-0a44-4583-8165-023b64ace119 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.817409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.818099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.818384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.818724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.819481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.821150 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.832007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1190/2357] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:20.836021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.874932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccaed0-ca3e-41ed-99f8-cc6976e33785 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.879640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac06db-259f-4b23-bd47-e2d0527d430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.880328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac06db-259f-4b23-bd47-e2d0527d430c admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.880612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac06db-259f-4b23-bd47-e2d0527d430c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.880887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac06db-259f-4b23-bd47-e2d0527d430c admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.881643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac06db-259f-4b23-bd47-e2d0527d430c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.883303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac06db-259f-4b23-bd47-e2d0527d430c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.894932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1168/2358] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:20.899529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:20.909304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b967f-7f29-46fc-b813-bc41cb432ed1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:20.913906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:20.914792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.915076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.915357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] PATH_INFO: `/v3/projects/4460c905d645436aac5706ebbe94796c/users/ceaa59af6d46414d868423cc53f1f177/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.930516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4460c905d645436aac5706ebbe94796c, user_id=ceaa59af6d46414d868423cc53f1f177, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:20.933194 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:20.950438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1191/2359] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:20 2022] PUT /identity/v3/projects/4460c905d645436aac5706ebbe94796c/users/ceaa59af6d46414d868423cc53f1f177/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:20.960742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7b71-ead1-4c23-a109-0a71f5b19726 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:20.961224 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7b71-ead1-4c23-a109-0a71f5b19726 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:20.961320 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7b71-ead1-4c23-a109-0a71f5b19726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:20.994318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1e9c7b71-ead1-4c23-a109-0a71f5b19726 None None] MFA Rules not processed for user `ceaa59af6d46414d868423cc53f1f177`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:20.995429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1e9c7b71-ead1-4c23-a109-0a71f5b19726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:21.061955 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1169/2360] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:21.073521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:21.075325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:21.151715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a8988-cba1-4916-be8c-303c1f2d6ffc admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:21.155377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:21.156680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:21.156961 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:21.157237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:21.165716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:21.167192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:21.176135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1192/2361] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:29.515096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:29.515895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:29.516327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:29.542214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:29.542214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:29.615223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1170/2362] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:29.628390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:29.629988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:29.700036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f6a4-bee4-4f4f-a5e4-49b0c65facd5 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:29.705084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:29.705733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:29.706042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:29.706314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:29.714424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:29.716061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:29.724546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1193/2363] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:53:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:53:31.292545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:31.298015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:31.392061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89dc9-6d9a-4b11-9ea9-43b548c22ca3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:31.397091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:31.398190 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:31.398478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:31.398760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] PATH_INFO: `/v3/users/6a399626a25d499e8831a80aa1623f89` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:31.399993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a399626a25d499e8831a80aa1623f89)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:31.402045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:31.486165 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:31.508991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b822536-bf9e-42c4-af03-6753eaf6a420 service swift] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:31.540263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:31.544722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:31.545737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:31.548078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] PATH_INFO: `/v3/users/ceaa59af6d46414d868423cc53f1f177` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:31.550780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceaa59af6d46414d868423cc53f1f177)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:31.556778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:31.557364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a399626a25d499e8831a80aa1623f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.595786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a399626a25d499e8831a80aa1623f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.612925 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a399626a25d499e8831a80aa1623f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.613745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a399626a25d499e8831a80aa1623f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.614375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-2dae02cf-8169-4a6e-9005-8293d22c7fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a399626a25d499e8831a80aa1623f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.637366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1171/2364] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:53:31 2022] DELETE /identity/v3/users/6a399626a25d499e8831a80aa1623f89 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:31.644067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:31.644749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:31.645326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:31.682487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceaa59af6d46414d868423cc53f1f177'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.693337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:31.695057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:31.700972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceaa59af6d46414d868423cc53f1f177'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.738509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceaa59af6d46414d868423cc53f1f177'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.741350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceaa59af6d46414d868423cc53f1f177'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.755251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-6ea27471-951d-49c2-b5e8-c856518e5157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceaa59af6d46414d868423cc53f1f177'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:31.773630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1194/2365] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:53:31 2022] DELETE /identity/v3/users/ceaa59af6d46414d868423cc53f1f177 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:31.777883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:31.778310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:31.778689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:31.800407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:31.801815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:31.809222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1172/2366] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:31.821483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:31.822901 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:31.875611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1195/2367] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:31.887947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:31.890344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:31.969062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe572-0a93-4adb-a081-3c8bb5a998c7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:32.113220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5761bb-c909-448d-9a39-18bfde0066ae None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:32.117429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:32.118231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:32.118824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:32.119208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:32.120536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:32.121428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:32.121518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:32.121722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:32.148319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:32.149888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:32.153348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:32.159746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:32.181655 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1196/2368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:53:32.185045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1173/2369] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:53:32.847482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:32.850419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:32.865662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6055-e555-4db5-870b-b044554641c5 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:32.870355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:32.871228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:32.871512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:32.871922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] PATH_INFO: `/v3/projects/286a1f00d02f48869545622deea1eaf5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:32.873325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] RBAC: Authorizing `identity:delete_project(project_id=286a1f00d02f48869545622deea1eaf5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:32.876557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:32.975025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286a1f00d02f48869545622deea1eaf5', 'request_id': 'req-8fb68edd-ffee-4574-81e3-01119ba3580e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:32.984259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286a1f00d02f48869545622deea1eaf5', 'request_id': 'req-8fb68edd-ffee-4574-81e3-01119ba3580e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:32.992033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286a1f00d02f48869545622deea1eaf5', 'request_id': 'req-8fb68edd-ffee-4574-81e3-01119ba3580e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.037035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] The token cache is being invalidate because project 286a1f00d02f48869545622deea1eaf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:53:33.048483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.050069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:33.050482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.051760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8fb68edd-ffee-4574-81e3-01119ba3580e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.056335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1197/2370] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:53:32 2022] DELETE /identity/v3/projects/286a1f00d02f48869545622deea1eaf5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:33.064453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb9d93-803c-4d7a-b8e3-e0baf1a84d49 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.065145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb9d93-803c-4d7a-b8e3-e0baf1a84d49 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.065696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb9d93-803c-4d7a-b8e3-e0baf1a84d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.070666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120739c-b905-485e-af2a-40768e24ace6 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.164925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-51fb9d93-803c-4d7a-b8e3-e0baf1a84d49 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:33.168491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-51fb9d93-803c-4d7a-b8e3-e0baf1a84d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:33.229486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:33.230640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.232127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.232520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] PATH_INFO: `/v3/projects/4460c905d645436aac5706ebbe94796c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.237591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4460c905d645436aac5706ebbe94796c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:33.240479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:33.322038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1198/2371] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:53:33.341882 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.342282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.343446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.371992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4460c905d645436aac5706ebbe94796c', 'request_id': 'req-914c8ac1-c50d-4159-a650-5c77f2b48a74'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.382448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4460c905d645436aac5706ebbe94796c', 'request_id': 'req-914c8ac1-c50d-4159-a650-5c77f2b48a74'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.392480 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4460c905d645436aac5706ebbe94796c', 'request_id': 'req-914c8ac1-c50d-4159-a650-5c77f2b48a74'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.417448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] The token cache is being invalidate because project 4460c905d645436aac5706ebbe94796c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:53:33.417750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.418490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-914c8ac1-c50d-4159-a650-5c77f2b48a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:33.421921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1174/2372] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:53:33 2022] DELETE /identity/v3/projects/4460c905d645436aac5706ebbe94796c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:33.427114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8604ca-4072-4488-a609-6ff326393254 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.427628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8604ca-4072-4488-a609-6ff326393254 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.428080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8604ca-4072-4488-a609-6ff326393254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.448791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:33.452634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:33.464140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-da8604ca-4072-4488-a609-6ff326393254 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:33.465384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-da8604ca-4072-4488-a609-6ff326393254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:33.627408 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1175/2373] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:33.629039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4866be-4043-453e-bd67-907d00838734 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.629343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4866be-4043-453e-bd67-907d00838734 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.629626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4866be-4043-453e-bd67-907d00838734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.683948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1199/2374] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:33.691700 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.691898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6e4866be-4043-453e-bd67-907d00838734 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:33.692537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6e4866be-4043-453e-bd67-907d00838734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:33.707905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1176/2375] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:33.709393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4866be-4043-453e-bd67-907d00838734 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.720329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4866be-4043-453e-bd67-907d00838734 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.723446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c14b3-f843-44a6-8de4-c294c50efd7a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.725639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:33.728652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.728652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.728652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.729310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:53:33.730370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:33.733151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:33.738448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:33.739942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.740235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.740514 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.742242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:53:33.742569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:33.749027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1177/2376] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:53:33.749591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:33.753394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.763948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6bdc-daf5-4ea9-8fca-361877b996a2 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.775380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:33.775380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.775380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.775380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.775891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:33.776400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:33.795005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1200/2377] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:53:33.799468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.816788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777df74-a07e-4561-8b9a-a50e807dde27 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.824033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:33.824790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.825117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.825394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.826118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:33.828011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1178/2378] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:33.829100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.830479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:33.884968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1201/2379] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:33.889092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:33.945969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f8e62-3069-4235-8202-79876cec9887 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.963627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08876571-dd7b-48f2-9274-b28b03d83e40 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:33.969602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:33.971118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:33.971570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:33.972026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:33.972896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:33.975351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.011197 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1202/2380] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:34.022127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.025193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.025193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.025193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.025193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.026579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.027122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.047039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34621a44-6549-4dd5-be30-406ef24b1edf admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.053668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.054457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.054721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.055021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.055754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.057672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.064784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1179/2381] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:33 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:34.069046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.072856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1203/2382] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:34.076827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.088521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6391c2-d531-4559-88b4-f9162330fc8b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.094161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.094835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.095116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.095342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951a55-d011-4a3f-8a28-1f860dca52ec admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.095472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.096098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.098149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.102621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.103510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.104023 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.104473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.106238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.109975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.122474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1180/2383] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:34.126509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.135793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1204/2384] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:34.137166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.146777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660741-6a23-4487-9448-2284ebcf210b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.152305 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836e2f1-efcd-4175-9e0e-0ab8fa838b02 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.153834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.154532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.155391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.155676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.156435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.159707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.161720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec79e3-ab42-4314-bf79-d26bfe4f81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.163134 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec79e3-ab42-4314-bf79-d26bfe4f81e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.163924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec79e3-ab42-4314-bf79-d26bfe4f81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.164374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec79e3-ab42-4314-bf79-d26bfe4f81e5 admin admin] PATH_INFO: `/v3/projects/d8469a7d8671451eb029d18b67e7f76d/users/86a6549a475a4cbe803ab5bed1c91e51/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.177286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1181/2385] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:34.188998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.189630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec79e3-ab42-4314-bf79-d26bfe4f81e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8469a7d8671451eb029d18b67e7f76d, user_id=86a6549a475a4cbe803ab5bed1c91e51, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.194403 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec79e3-ab42-4314-bf79-d26bfe4f81e5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.207168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a1894-d1ee-4443-8571-45ff24e488de admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.229135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1205/2386] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:34 2022] PUT /identity/v3/projects/d8469a7d8671451eb029d18b67e7f76d/users/86a6549a475a4cbe803ab5bed1c91e51/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:34.234175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.234783 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.235218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.253071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:34.254427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:34.312673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8a9bb-da0d-4b44-9f82-b23719b90858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.314149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8a9bb-da0d-4b44-9f82-b23719b90858 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.314790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8a9bb-da0d-4b44-9f82-b23719b90858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.315412 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8a9bb-da0d-4b44-9f82-b23719b90858 admin admin] PATH_INFO: `/v3/projects/6ce506c63f16445cac166f16104398cd/users/d5eebbc0c8574cd58c022f2cc0e9f1eb/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.345590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1206/2387] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:53:34.354554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.356029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:34.358008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8a9bb-da0d-4b44-9f82-b23719b90858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce506c63f16445cac166f16104398cd, user_id=d5eebbc0c8574cd58c022f2cc0e9f1eb, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.361341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8a9bb-da0d-4b44-9f82-b23719b90858 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.381003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1182/2388] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:34 2022] PUT /identity/v3/projects/6ce506c63f16445cac166f16104398cd/users/d5eebbc0c8574cd58c022f2cc0e9f1eb/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:34.388819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.388819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.388819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.410666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:34.412256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:34.438384 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef7eb-77f1-49ee-9b87-b61afdc241df None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.498209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.499298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.499764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.500297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.557261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1183/2389] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:34.558209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.559547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:34.578023 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ed9c-5f5c-4e32-b4a5-89787661ee43 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.583663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.584701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.585032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.585316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] PATH_INFO: `/v3/users/5006a5849bc94c17bd34f0dbf84c8351` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.586393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.586570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5006a5849bc94c17bd34f0dbf84c8351)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.588625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.588905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.606819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1207/2390] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:34.610756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.613953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:34.650344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911a48-beaa-4555-a348-aafcf06468d6 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:34.655503 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f24ca-6c7c-4cfd-b88e-d357f74555b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:34.656497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f24ca-6c7c-4cfd-b88e-d357f74555b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.657444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f24ca-6c7c-4cfd-b88e-d357f74555b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.658454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f24ca-6c7c-4cfd-b88e-d357f74555b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.673474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f24ca-6c7c-4cfd-b88e-d357f74555b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:34.675455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f24ca-6c7c-4cfd-b88e-d357f74555b3 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:34.694067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1208/2391] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:34.704154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5006a5849bc94c17bd34f0dbf84c8351'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:34.724081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5006a5849bc94c17bd34f0dbf84c8351'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:34.759290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5006a5849bc94c17bd34f0dbf84c8351'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:34.760127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5006a5849bc94c17bd34f0dbf84c8351'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:34.761271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5006a5849bc94c17bd34f0dbf84c8351'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:34.786175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1184/2392] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:53:34 2022] DELETE /identity/v3/users/5006a5849bc94c17bd34f0dbf84c8351 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:34.790908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:34.791215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:34.791458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:34.825233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:34.826564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:34.912805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1209/2393] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:53:34.925551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:34.927616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:35.053343 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337081-270c-4042-92bb-f0aa2c41328e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:35.059509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b733a-3488-495f-a500-b1df5efb8d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:35.060236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b733a-3488-495f-a500-b1df5efb8d99 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:35.060520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b733a-3488-495f-a500-b1df5efb8d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:35.060792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b733a-3488-495f-a500-b1df5efb8d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:35.080658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b733a-3488-495f-a500-b1df5efb8d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:35.083197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b733a-3488-495f-a500-b1df5efb8d99 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:35.107864 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1185/2394] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:36.379388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:36.381432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:36.403804 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef6ebb-2888-4d67-9923-76bc2080021f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:36.417191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:36.418104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:36.418388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:36.418660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] PATH_INFO: `/v3/projects/56a50db804764d59940834e6120f54b0` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:36.420206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a50db804764d59940834e6120f54b0)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:36.423198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:36.547443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a50db804764d59940834e6120f54b0', 'request_id': 'req-5d9b7873-ef37-45d5-8571-48151add900b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:36.566402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a50db804764d59940834e6120f54b0', 'request_id': 'req-5d9b7873-ef37-45d5-8571-48151add900b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:36.579995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a50db804764d59940834e6120f54b0', 'request_id': 'req-5d9b7873-ef37-45d5-8571-48151add900b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:36.603206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] The token cache is being invalidate because project 56a50db804764d59940834e6120f54b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:53:36.605629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:36.609989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5d9b7873-ef37-45d5-8571-48151add900b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:53:36.612353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1210/2395] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:53:36 2022] DELETE /identity/v3/projects/56a50db804764d59940834e6120f54b0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:36.617530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:36.618419 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:36.618943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:36.658762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:36.660441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:36.803281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1186/2396] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:36.812040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:36.812364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:36.812748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:36.846549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:36.847308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:36.870901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1211/2397] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:36.875232 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:36.886613 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22787eba-af38-4d32-a50c-e31fde6d7b4c None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:36.902767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:36.903466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:36.903746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:36.904020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:36.904747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:53:36.906007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:36.907726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:36.935341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1187/2398] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:53:36.940574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:36.959508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93778036-c323-4c44-ab54-6fb63382e55d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:36.972275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:36.973207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:36.973495 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:36.973770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:36.974522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:36.977765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:37.067102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1212/2399] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:36 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:37.071529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:37.088830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fc9b-234c-4369-9738-5d23bf629903 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:37.163808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:37.164601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:37.166035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:37.167078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:37.168661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:37.175606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:37.220091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1188/2400] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:37 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:37.227185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:37.241600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d95993-cc24-4ba1-aacf-8691892d4b53 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:37.253253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:37.254061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:37.256992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:37.257644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:37.258497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:37.262009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:37.293337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1213/2401] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:37.294460 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:37.306895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a13e0-8723-4b9e-9460-1cfed6cadc49 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:37.324632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774d6c7-0da7-43c6-a90d-50735eb60b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:37.325432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774d6c7-0da7-43c6-a90d-50735eb60b67 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:37.325787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774d6c7-0da7-43c6-a90d-50735eb60b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:37.327494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774d6c7-0da7-43c6-a90d-50735eb60b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:37.330230 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774d6c7-0da7-43c6-a90d-50735eb60b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:37.332060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774d6c7-0da7-43c6-a90d-50735eb60b67 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:37.354066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:37.369153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1189/2402] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:37.372245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb31ab-f075-4cb0-b084-5e0f50e6111a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:37.378624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:37.379579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:37.380118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:37.380198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] PATH_INFO: `/v3/projects/3ecfade47630412b85598218c7c04664/users/b6c5fac3bd10428d87723eaf90bcbfac/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:37.401906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecfade47630412b85598218c7c04664, user_id=b6c5fac3bd10428d87723eaf90bcbfac, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:37.405418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:37.454953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555000b-84ff-4782-8a3f-e75b61377477 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:37.455430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555000b-84ff-4782-8a3f-e75b61377477 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:37.455554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555000b-84ff-4782-8a3f-e75b61377477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:37.456895 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1214/2403] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:37 2022] PUT /identity/v3/projects/3ecfade47630412b85598218c7c04664/users/b6c5fac3bd10428d87723eaf90bcbfac/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:37.476220 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8555000b-84ff-4782-8a3f-e75b61377477 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:37.477430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8555000b-84ff-4782-8a3f-e75b61377477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:37.599291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1190/2404] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:37.615855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:37.618335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:37.724006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382e070-a828-4045-8292-f59188768c62 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:37.728236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:37.729321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:37.729321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:37.729631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:37.773822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:37.775355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:37.808472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1215/2405] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:53:47.154548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:47.155109 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:47.155219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:47.254853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] MFA Rules not processed for user `86a6549a475a4cbe803ab5bed1c91e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:47.256106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:47.575598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1191/2406] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:47.583936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:47.586220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:47.638071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c729eb-8ee7-40c8-9cda-51cf5e93e91b service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:47.651555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75168b-5702-4d95-9ca8-7638135279fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:47.652405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75168b-5702-4d95-9ca8-7638135279fb admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:47.652865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75168b-5702-4d95-9ca8-7638135279fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:47.653258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75168b-5702-4d95-9ca8-7638135279fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:47.654098 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75168b-5702-4d95-9ca8-7638135279fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:47.659475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75168b-5702-4d95-9ca8-7638135279fb admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:47.766022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1216/2407] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:47 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:47.768592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:47.786824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a74e8-8fc8-4db3-9a99-a1dff8bfcb65 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:47.950618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:47.950900 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:47.951593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.011099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] MFA Rules not processed for user `d5eebbc0c8574cd58c022f2cc0e9f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:48.013684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:48.028459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.029149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.029428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.029817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.030549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.041939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.091971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1192/2408] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:47 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:48.095563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.127429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281108e-adc9-4793-b7d5-c6031de46ba4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:48.158231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.158933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.159221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.159487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.160550 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.163947 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.190300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1193/2409] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:53:48.199121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.214371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1217/2410] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:53:48.222925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.235765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:48.266015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1449c5-b886-43b9-b796-f5853ba0c9cb admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:48.270958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0e3d6-a73e-4980-879e-830f8e181f4f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:48.285125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.286601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.287058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.287517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.289126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.291429 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.298208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.300699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.307119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.307458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] PATH_INFO: `/v3/projects/deaef75ee29a4ba8bbc186e18d9b111c/users/b2df75fe21084ff6a4ce28f53e0c0af5/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.351491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1218/2411] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:48 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:48.355622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.402233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=deaef75ee29a4ba8bbc186e18d9b111c, user_id=b2df75fe21084ff6a4ce28f53e0c0af5, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.411241 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.445131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1194/2412] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:48 2022] PUT /identity/v3/projects/deaef75ee29a4ba8bbc186e18d9b111c/users/b2df75fe21084ff6a4ce28f53e0c0af5/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:48.446150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.535177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1a814-44d8-43af-9868-755e3d5259ad admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:48.689590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1895b8-b543-4547-a55d-cdd2c76b8d0c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:48.703199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.703915 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.704218 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.704486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.705233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.706924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.752975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1195/2413] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:48.758122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.795682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1b65-2ddf-4283-af65-4a5037656e63 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:48.814638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.815979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.816422 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.816857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] PATH_INFO: `/v3/projects/deaef75ee29a4ba8bbc186e18d9b111c/users/b2df75fe21084ff6a4ce28f53e0c0af5/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.818523 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:48.819933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:48.820379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:48.820814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:48.821689 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.823351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deaef75ee29a4ba8bbc186e18d9b111c, user_id=b2df75fe21084ff6a4ce28f53e0c0af5, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:48.824108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.826064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:48.865231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1196/2414] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:48 2022] PUT /identity/v3/projects/deaef75ee29a4ba8bbc186e18d9b111c/users/b2df75fe21084ff6a4ce28f53e0c0af5/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:48.954149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:48.954371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1219/2415] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:48 2022] POST /identity/v3/users => generated 295 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:53:49.235716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a463f-538c-4bf5-90df-7e8d8abd9d79 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:49.258387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:49.258695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:49.258991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:49.259291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:49.260004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:49.262581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:49.298586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1197/2416] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:53:49.302828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:49.325275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7bc46-705a-4b39-86af-a2b1df490495 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:49.340717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8262d5-0f67-4f1e-be89-e4d1f6b51e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:49.341647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8262d5-0f67-4f1e-be89-e4d1f6b51e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:49.342504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8262d5-0f67-4f1e-be89-e4d1f6b51e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:49.354876 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8262d5-0f67-4f1e-be89-e4d1f6b51e8d admin admin] PATH_INFO: `/v3/projects/8ff63744c7e544d6b97ee26825261929/users/dee058bc1b304379b06f5f7f05e007a9/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:49.410144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8262d5-0f67-4f1e-be89-e4d1f6b51e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff63744c7e544d6b97ee26825261929, user_id=dee058bc1b304379b06f5f7f05e007a9, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:49.412990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8262d5-0f67-4f1e-be89-e4d1f6b51e8d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:49.453042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1220/2417] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:49 2022] PUT /identity/v3/projects/8ff63744c7e544d6b97ee26825261929/users/dee058bc1b304379b06f5f7f05e007a9/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:49.456802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:49.476746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed70e-5e2a-461e-96ca-97e23d5bf542 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:49.583153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:49.583451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:49.583731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:49.660069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] MFA Rules not processed for user `b6c5fac3bd10428d87723eaf90bcbfac`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:49.663582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:49.680489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:49.682403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:49.687624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:49.688637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:49.692963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:49.716882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:49.755478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1198/2418] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:49.771706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:49.793243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97780-77f2-4724-aa33-3df3d95ed292 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:49.808547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:49.809993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:49.810430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:49.812269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] PATH_INFO: `/v3/projects/8ff63744c7e544d6b97ee26825261929/users/dee058bc1b304379b06f5f7f05e007a9/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:49.821518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff63744c7e544d6b97ee26825261929, user_id=dee058bc1b304379b06f5f7f05e007a9, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:49.824543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:49.840084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1221/2419] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:53:49.841011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:49.872126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea375-27cf-4367-bcec-6ca88dc4e4f2 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:49.887015 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1199/2420] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:49 2022] PUT /identity/v3/projects/8ff63744c7e544d6b97ee26825261929/users/dee058bc1b304379b06f5f7f05e007a9/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:50.092572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:50.101935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:50.102354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:50.102788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:50.104272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:50.116177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:50.194794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1222/2421] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:53:49 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:50.196353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:50.209650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba509e1a-5a9c-40df-8880-13b8d282ca35 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:50.353835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:50.355669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:50.356173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:50.356671 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:50.358115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:50.363674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:50.401471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1200/2422] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:53:50 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:53:50.407768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:50.425770 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa714cf-5662-4a73-a3c4-2d07086da75e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:50.434793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:50.435490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:50.437533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:50.439001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:50.442152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:50.450036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:50.478146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1223/2423] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:50.481813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:50.492517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e370d-040c-4263-84dd-f666ecb59836 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:50.508787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:50.511356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:50.511885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:50.513146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] PATH_INFO: `/v3/projects/5464d798d7924c0cb4bf034d1347235a/users/5f8babd08def4407996f00f3abc16017/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:50.542394 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464d798d7924c0cb4bf034d1347235a, user_id=5f8babd08def4407996f00f3abc16017, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:50.547462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:50.570496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1201/2424] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:50 2022] PUT /identity/v3/projects/5464d798d7924c0cb4bf034d1347235a/users/5f8babd08def4407996f00f3abc16017/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:53:50.575153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:50.595756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a75b-a7d9-4362-b17e-987c39211d39 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:50.664460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3054-7b15-437a-9d02-d592ed518845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:50.665147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3054-7b15-437a-9d02-d592ed518845 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:50.665431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3054-7b15-437a-9d02-d592ed518845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:50.665927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3054-7b15-437a-9d02-d592ed518845 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:50.666808 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3054-7b15-437a-9d02-d592ed518845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:50.668862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3054-7b15-437a-9d02-d592ed518845 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:50.680145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1224/2425] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:53:50.684540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:50.696778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e43ce4-1ebf-4deb-8607-e6f1e7fe9bd2 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:50.703424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:50.704669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:50.704953 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:50.705231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] PATH_INFO: `/v3/projects/5464d798d7924c0cb4bf034d1347235a/users/5f8babd08def4407996f00f3abc16017/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:50.707616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5464d798d7924c0cb4bf034d1347235a, user_id=5f8babd08def4407996f00f3abc16017, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:50.710342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:50.725942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1202/2426] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:53:50 2022] PUT /identity/v3/projects/5464d798d7924c0cb4bf034d1347235a/users/5f8babd08def4407996f00f3abc16017/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:53:58.067800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3d09-b58e-4d2a-a0e4-82b7b40c859a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:58.068781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3d09-b58e-4d2a-a0e4-82b7b40c859a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:58.069251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3d09-b58e-4d2a-a0e4-82b7b40c859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:58.136669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d66e3d09-b58e-4d2a-a0e4-82b7b40c859a None None] MFA Rules not processed for user `dee058bc1b304379b06f5f7f05e007a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:53:58.138883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d66e3d09-b58e-4d2a-a0e4-82b7b40c859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:58.244129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1225/2427] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:53:58.252903 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:53:58.256060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:53:58.445148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012d82d-0a3a-423b-b3fc-bf3a379bc516 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:53:58.456359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:53:58.457699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:53:58.458125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:53:58.458581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:53:58.561528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:53:58.563945 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:53:58.598221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1203/2428] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:00.942533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:00.943019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:00.943244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:01.022857 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] MFA Rules not processed for user `b2df75fe21084ff6a4ce28f53e0c0af5`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:01.026001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:01.255728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1226/2429] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:01.272477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:01.287495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f318f2-6b70-4fe6-b538-350b0cc1627e service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:01.305493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd569-2bef-4b49-8384-9d59fdde9c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:01.307942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd569-2bef-4b49-8384-9d59fdde9c28 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:01.308341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd569-2bef-4b49-8384-9d59fdde9c28 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:01.308725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd569-2bef-4b49-8384-9d59fdde9c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:01.470600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd569-2bef-4b49-8384-9d59fdde9c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:01.472830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd569-2bef-4b49-8384-9d59fdde9c28 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:01.486691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1204/2430] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:02.309157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:02.314559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:02.485724 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecebfd-8a3a-4c3a-9410-aaa3089d71e4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:02.492661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:02.493832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:02.494344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:02.494820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:02.499412 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:02.518083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:02.520027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:02.533250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1227/2431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:03.736926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86852f92-5e15-442a-b8fa-9637613cba3e None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:03.737553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86852f92-5e15-442a-b8fa-9637613cba3e None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:03.737711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86852f92-5e15-442a-b8fa-9637613cba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:03.816991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-86852f92-5e15-442a-b8fa-9637613cba3e None None] MFA Rules not processed for user `5f8babd08def4407996f00f3abc16017`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:03.818646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-86852f92-5e15-442a-b8fa-9637613cba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:04.026884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1205/2432] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:04.041505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:04.043500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:04.170421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16f803-261c-42f6-86a0-a5bc7aac446f service placement] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:04.175479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:04.176337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:04.176865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:04.177350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:04.254088 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:04.256246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:04.298047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1228/2433] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:04.587299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b11d-bb16-41e8-851a-a006a0b95e11 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:04.587599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b11d-bb16-41e8-851a-a006a0b95e11 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:04.587934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b11d-bb16-41e8-851a-a006a0b95e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:04.683909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d9c8b11d-bb16-41e8-851a-a006a0b95e11 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:04.686372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d9c8b11d-bb16-41e8-851a-a006a0b95e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:04.878675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1206/2434] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:04.905268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:04.906810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:05.095501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423355d-4fc3-4544-be26-68af94ec10d6 service glance] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:05.104957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74236edf-7243-4fdc-b452-64ae76cb96c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:05.105675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74236edf-7243-4fdc-b452-64ae76cb96c1 service swift] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:05.106005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74236edf-7243-4fdc-b452-64ae76cb96c1 service swift] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:05.106382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74236edf-7243-4fdc-b452-64ae76cb96c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:05.117322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74236edf-7243-4fdc-b452-64ae76cb96c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:05.120631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74236edf-7243-4fdc-b452-64ae76cb96c1 service swift] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:05.133750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1229/2435] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:54:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:05.319743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01d44-35bc-4c58-b2e1-8373b2c94b4f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:05.320249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01d44-35bc-4c58-b2e1-8373b2c94b4f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:05.320693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01d44-35bc-4c58-b2e1-8373b2c94b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:05.363318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e0b01d44-35bc-4c58-b2e1-8373b2c94b4f None None] MFA Rules not processed for user `86a6549a475a4cbe803ab5bed1c91e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:05.364629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e0b01d44-35bc-4c58-b2e1-8373b2c94b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:05.382375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1207/2436] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:05.807149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801891-ea92-40b3-a0ae-8520f772cb2c None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:05.807810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801891-ea92-40b3-a0ae-8520f772cb2c None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:05.808326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801891-ea92-40b3-a0ae-8520f772cb2c None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:05.816519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1230/2437] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:54:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:54:05.836969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca3e8-438e-4119-9d5c-a1db17ad70f5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:05.837249 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca3e8-438e-4119-9d5c-a1db17ad70f5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:05.837537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca3e8-438e-4119-9d5c-a1db17ad70f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:05.940354 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-696ca3e8-438e-4119-9d5c-a1db17ad70f5 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:05.946998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-696ca3e8-438e-4119-9d5c-a1db17ad70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:05.970082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1208/2438] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:54:14.548389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801891-ea92-40b3-a0ae-8520f772cb2c None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:14.598072 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801891-ea92-40b3-a0ae-8520f772cb2c None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:14.610126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434aa21-ccba-40da-b596-3c82d3e19384 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:14.612666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434aa21-ccba-40da-b596-3c82d3e19384 service glance] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:14.612958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434aa21-ccba-40da-b596-3c82d3e19384 service glance] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:14.613234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434aa21-ccba-40da-b596-3c82d3e19384 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:14.624981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434aa21-ccba-40da-b596-3c82d3e19384 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:14.631536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434aa21-ccba-40da-b596-3c82d3e19384 service glance] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:14.647872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1231/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:14.768600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a350b-ebb0-4746-b751-39a58b4e7a7d None None] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:14.771400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a350b-ebb0-4746-b751-39a58b4e7a7d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:14.771878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a350b-ebb0-4746-b751-39a58b4e7a7d None None] PATH_INFO: `/` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:14.774665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1209/2440] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:54:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:54:14.782983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007f34-9b45-4a63-a066-3c5c281947b8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:14.783550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007f34-9b45-4a63-a066-3c5c281947b8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:14.784200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007f34-9b45-4a63-a066-3c5c281947b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:14.846294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a7007f34-9b45-4a63-a066-3c5c281947b8 None None] MFA Rules not processed for user `e45b81aa59fd4b26bc1434c9191c20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:14.847292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a7007f34-9b45-4a63-a066-3c5c281947b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:14.968132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1232/2441] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:54:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:14.981918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a350b-ebb0-4746-b751-39a58b4e7a7d None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:15.001712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a350b-ebb0-4746-b751-39a58b4e7a7d None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:15.007472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18205fb8-df87-41a5-a692-277db64056e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:15.009763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205fb8-df87-41a5-a692-277db64056e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:15.010549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205fb8-df87-41a5-a692-277db64056e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:15.011585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18205fb8-df87-41a5-a692-277db64056e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:15.026700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205fb8-df87-41a5-a692-277db64056e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:15.030814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18205fb8-df87-41a5-a692-277db64056e5 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:15.046130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1210/2442] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:54:15.245809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b91a-070d-4f17-ada7-ec673b7ca8d0 None None] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:15.246124 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b91a-070d-4f17-ada7-ec673b7ca8d0 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:15.246522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b91a-070d-4f17-ada7-ec673b7ca8d0 None None] PATH_INFO: `/` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:15.249796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1233/2443] 10.222.0.30 () {54 vars in 921 bytes} [Tue Mar 8 14:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 14:54:15.269836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0433dc-e641-4a21-a493-1951c84febf5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:15.270169 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0433dc-e641-4a21-a493-1951c84febf5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:15.270949 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0433dc-e641-4a21-a493-1951c84febf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:15.373428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ec0433dc-e641-4a21-a493-1951c84febf5 None None] MFA Rules not processed for user `54185e0e2c5549f3b397a8009ae27713`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:15.374957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ec0433dc-e641-4a21-a493-1951c84febf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:15.411837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1211/2444] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Mar 8 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:54:15.420126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6b91a-070d-4f17-ada7-ec673b7ca8d0 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:15.442867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6b91a-070d-4f17-ada7-ec673b7ca8d0 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:15.458759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4713c-13d6-46df-876c-e216c5f2d464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:15.460554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4713c-13d6-46df-876c-e216c5f2d464 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:15.460852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4713c-13d6-46df-876c-e216c5f2d464 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:15.461129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4713c-13d6-46df-876c-e216c5f2d464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:15.493937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4713c-13d6-46df-876c-e216c5f2d464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:15.495585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4713c-13d6-46df-876c-e216c5f2d464 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:15.543615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1234/2445] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:20.334565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:20.335126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:20.335126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:20.352769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] MFA Rules not processed for user `b6c5fac3bd10428d87723eaf90bcbfac`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:20.353969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:20.360787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1212/2446] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:22.796506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b65f4-4332-4940-928d-521290cecea4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:22.797107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b65f4-4332-4940-928d-521290cecea4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:22.797107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b65f4-4332-4940-928d-521290cecea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:22.853202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7b2b65f4-4332-4940-928d-521290cecea4 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:22.854580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7b2b65f4-4332-4940-928d-521290cecea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:22.875593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1235/2447] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:54:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:22.891529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:22.917510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8c63-4ec9-4d9c-bb4f-6778e6367248 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:22.924704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a209446-a157-44bf-b0dd-a3aa648631f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:22.925385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209446-a157-44bf-b0dd-a3aa648631f6 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:22.925672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209446-a157-44bf-b0dd-a3aa648631f6 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:22.925996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209446-a157-44bf-b0dd-a3aa648631f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:22.936744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a209446-a157-44bf-b0dd-a3aa648631f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:22.937894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a209446-a157-44bf-b0dd-a3aa648631f6 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:22.947145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1213/2448] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:54:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:23.965232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bb42-00c6-41fc-823b-b17c97ec331b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:23.966547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bb42-00c6-41fc-823b-b17c97ec331b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:23.966875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296bb42-00c6-41fc-823b-b17c97ec331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:23.985051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0296bb42-00c6-41fc-823b-b17c97ec331b None None] MFA Rules not processed for user `6d080fb7bd6049dea53fe1912d46b11b`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:23.986282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0296bb42-00c6-41fc-823b-b17c97ec331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:24.067801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1236/2449] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:27.479700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:27.480274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:27.480274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:27.498745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] MFA Rules not processed for user `d5eebbc0c8574cd58c022f2cc0e9f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:27.499984 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:27.507060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1214/2450] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:34.458461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722d8b-367c-48da-b099-9162bf100ebd None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:34.459021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722d8b-367c-48da-b099-9162bf100ebd None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:34.459021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722d8b-367c-48da-b099-9162bf100ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:34.479899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-25722d8b-367c-48da-b099-9162bf100ebd None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:34.482765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-25722d8b-367c-48da-b099-9162bf100ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:34.503201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1237/2451] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:34.520587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:34.533609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3676ed-2378-4aab-85eb-cd452e77ab1a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:34.539580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:34.540228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:34.540678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:34.541143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:34.551516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:34.553555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:34.581234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1215/2452] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:51.265948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:51.266540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:51.266540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:51.288942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:51.290446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:51.298607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1238/2453] 10.222.0.30 () {58 vars in 967 bytes} [Tue Mar 8 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:51.337279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:51.348797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3b5f-2ca0-48b4-ab4a-6555fbb50ec6 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:51.356025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:51.356858 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:51.357138 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:51.357589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:51.367203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:51.369067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:51.379595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1216/2454] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 14:54:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:54.447145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:54.448592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:54.512438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63283d-d9a2-4a81-8137-cc23a8226d33 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:54.516971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:54.517838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:54.518137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:54.518408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] PATH_INFO: `/v3/users/00aa26c0dc804f949002193e1919183d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:54.519574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00aa26c0dc804f949002193e1919183d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:54.521512 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:54.566970 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00aa26c0dc804f949002193e1919183d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.574754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00aa26c0dc804f949002193e1919183d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.586551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00aa26c0dc804f949002193e1919183d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.587239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00aa26c0dc804f949002193e1919183d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.593778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5759227e-045c-4350-a819-cb8d50336524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00aa26c0dc804f949002193e1919183d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.599505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1239/2455] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 14:54:54 2022] DELETE /identity/v3/users/00aa26c0dc804f949002193e1919183d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:54:54.770782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:54.781431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879c3f-8b69-4e15-b317-f3275156fd5f service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:54.844600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:54.845500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:54.845783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:54.846115 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] PATH_INFO: `/v3/projects/7ac3fd6058904fbabe43c68e8d7c7654` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:54.847300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac3fd6058904fbabe43c68e8d7c7654)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:54.849197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:54.895467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac3fd6058904fbabe43c68e8d7c7654', 'request_id': 'req-32d734fc-1bba-4897-94d0-d013ba2532fe'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.902998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac3fd6058904fbabe43c68e8d7c7654', 'request_id': 'req-32d734fc-1bba-4897-94d0-d013ba2532fe'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.909505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac3fd6058904fbabe43c68e8d7c7654', 'request_id': 'req-32d734fc-1bba-4897-94d0-d013ba2532fe'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.920473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] The token cache is being invalidate because project 7ac3fd6058904fbabe43c68e8d7c7654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:54:54.920760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.921405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-32d734fc-1bba-4897-94d0-d013ba2532fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:54:54.923242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1217/2456] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 14:54:54 2022] DELETE /identity/v3/projects/7ac3fd6058904fbabe43c68e8d7c7654 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:54:54.934055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:54.934696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:54.935220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:54.955870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:54.957205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:55.019071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1240/2457] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:55.026832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.027658 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.027936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.063250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:55.064770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:55.078281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1218/2458] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:55.079190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.101455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7003556-e6c2-4185-bda8-e1fb3ae570f6 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.120059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.122845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.123173 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.123456 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.124228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:54:55.124538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.126303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.155154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1241/2459] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 14:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:54:55.159651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.175863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c215a-04c3-4b3c-a5bd-5cdb11c9ea12 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.183871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.185165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.185607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.186068 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.187051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.189428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.239854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1219/2460] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:54:55 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:54:55.244602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.261121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb717-a547-492b-ac53-ed3cadb308ea admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.345156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.346147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.346779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.348050 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.348924 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.351293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.396357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1242/2461] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:54:55 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:54:55.397682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.412335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5e8a-a284-4bad-a8ae-3741bb50bb43 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.428288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.429664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.430293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.430602 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.431332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.439055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.456392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1220/2462] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:54:55.457013 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.467856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688545-36c9-4843-972c-2fc33cf6e2ca admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.473132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc80a-7eb0-4292-a89e-e66321f6e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.473811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc80a-7eb0-4292-a89e-e66321f6e550 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.474145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc80a-7eb0-4292-a89e-e66321f6e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.474565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc80a-7eb0-4292-a89e-e66321f6e550 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.475294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dc80a-7eb0-4292-a89e-e66321f6e550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.477058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dc80a-7eb0-4292-a89e-e66321f6e550 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.488815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1243/2463] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:54:55.493112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.507614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b1136-4f8c-4c2e-845c-37eb96fd4b45 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.515839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.516966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.517260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.517541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] PATH_INFO: `/v3/projects/1d7d3583d67848789b9bbab1e037d35f/users/240aab1005904d37b1ed9eb6ba87d32d/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.534965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7d3583d67848789b9bbab1e037d35f, user_id=240aab1005904d37b1ed9eb6ba87d32d, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.537782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.554013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1221/2464] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:54:55 2022] PUT /identity/v3/projects/1d7d3583d67848789b9bbab1e037d35f/users/240aab1005904d37b1ed9eb6ba87d32d/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:54:55.564382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.564676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.565028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.602155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] MFA Rules not processed for user `240aab1005904d37b1ed9eb6ba87d32d`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:55.603358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:55.676574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1244/2465] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:54:55.681541 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.786395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8431b-1350-4215-ae6b-8e02823f0d4a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.792063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.794475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.795818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.796540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.797439 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.800518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.837416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1222/2466] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 14:54:55 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:54:55.841397 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:55.853739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2418-2f77-4f2d-af64-2e6df09ec684 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:55.953896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:55.954862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:55.955348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:55.955622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:55.956955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:55.959829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:55.983816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1245/2467] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 14:54:55 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:54:55.988685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:56.004471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca248a44-8666-443d-9503-f218373b65e1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:56.009319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:56.010270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.010270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.010491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.011197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:56.013490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:56.035124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1223/2468] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:54:56.039187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:56.049646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4fa0-a4ab-4025-bcc5-35de1affa375 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:56.054762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:56.055649 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.055927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.056200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] PATH_INFO: `/v3/projects/8d42a73f76cb47599c4b8bff196a5001/users/aec4163426de404fb7dd478e7c00aaeb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.072435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d42a73f76cb47599c4b8bff196a5001, user_id=aec4163426de404fb7dd478e7c00aaeb, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:56.075565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:56.090220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1246/2469] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:54:56 2022] PUT /identity/v3/projects/8d42a73f76cb47599c4b8bff196a5001/users/aec4163426de404fb7dd478e7c00aaeb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:54:56.094739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:56.104260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364685f-c810-47ce-af84-e6ab947ed5fe admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:56.163705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da476f1-123b-4916-8468-e58f42820a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:56.164380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da476f1-123b-4916-8468-e58f42820a12 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.164694 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da476f1-123b-4916-8468-e58f42820a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.164930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da476f1-123b-4916-8468-e58f42820a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.165716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da476f1-123b-4916-8468-e58f42820a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:56.167428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da476f1-123b-4916-8468-e58f42820a12 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:56.185153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1224/2470] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 14:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:54:56.185813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:56.202912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc683d8-3b00-4b0d-9d21-74bdd6ff9544 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:56.210213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:56.211144 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.211501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.211875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] PATH_INFO: `/v3/projects/8d42a73f76cb47599c4b8bff196a5001/users/aec4163426de404fb7dd478e7c00aaeb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.224765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d42a73f76cb47599c4b8bff196a5001, user_id=aec4163426de404fb7dd478e7c00aaeb, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:56.229769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:56.259540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1247/2471] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 14:54:56 2022] PUT /identity/v3/projects/8d42a73f76cb47599c4b8bff196a5001/users/aec4163426de404fb7dd478e7c00aaeb/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:54:56.270753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.271120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.271610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.317743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] MFA Rules not processed for user `aec4163426de404fb7dd478e7c00aaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:54:56.319074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:56.423738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1225/2472] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:54:56.431332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:56.433837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:54:56.533275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb13274-b13e-4a21-aa08-6977e284dd9e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:56.537522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:56.538217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.538500 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.538949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.548762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:56.550188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:56.560752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1248/2473] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:54:56.635491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:54:56.645437 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92a000-ba42-4a54-9282-7b923b917f07 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:54:56.649209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:54:56.649885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:54:56.650165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:54:56.650441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:54:56.707423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:54:56.709010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:54:56.718592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1226/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:55:00.249470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:55:00.250955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:55:00.306582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109296dc-f0bf-4011-be3f-fe8e339c7e53 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:55:00.310308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:55:00.310941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:55:00.311218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:55:00.311494 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:55:00.313207 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:55:00.505359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:55:00.506818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac492db-9f93-4e85-a888-9268fc3dd01a service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:55:00.516624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1249/2475] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:55:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:55:06.368548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:55:06.369987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:55:06.381749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfae2-95cf-4067-9e54-804d1f7a1e87 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:55:06.385217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:55:06.385842 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:55:06.386287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:55:06.386702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:55:06.388404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:55:06.447521 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:55:06.448973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:55:06.458111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1227/2476] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:55:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:55:54.436222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:55:54.436784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:55:54.436784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:55:54.453774 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] MFA Rules not processed for user `51ed61d0a16d465889c0474a4d2b7dee`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:55:54.455018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:55:54.506625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1250/2477] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:56:01.083716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:56:01.092251 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17537d8-566e-451c-9e23-fef0cff7cfc6 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:56:01.095911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:56:01.096547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:56:01.096830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:56:01.097108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:56:01.098913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:56:01.167657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:56:01.169126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:56:01.180090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1228/2478] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:56:03.698051 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:56:03.707607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92441ebb-45fe-4209-b6b5-6ba559854133 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:56:03.711516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:56:03.713020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:56:03.713273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:56:03.713565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:56:03.715398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:56:03.728843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:56:03.730327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:56:03.742435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1251/2479] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:56:03.876436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:56:03.885408 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04281-6cbc-4c21-8fdc-59a740cb12ef service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:56:03.889053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:56:03.889690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:56:03.890007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:56:03.890289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:56:03.892049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:56:03.952465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:56:03.953946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:56:03.964122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1229/2480] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:56:21.188949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:56:21.190478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:56:21.203980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062917c-ccc0-42a8-89cd-0f3585bcc317 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:56:21.209463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:56:21.210127 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:56:21.210406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:56:21.210676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:56:21.212498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:56:21.267133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:56:21.268694 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:56:21.278074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1252/2481] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:56:46.253397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:56:46.265410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f093297-d757-41a3-a36f-b47cd352c4d3 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:56:46.270747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:56:46.271377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:56:46.271660 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:56:46.271934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:56:46.273672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:56:46.284426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:56:46.286305 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:56:46.297193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1230/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:57:07.520037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:57:07.529053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1f06-1206-43bb-9056-3b70cb45a427 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:57:07.533424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:57:07.534089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:57:07.534373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:57:07.534650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:57:07.536416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:57:07.545749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:57:07.547242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:57:07.554892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1253/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:57:11.268370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:57:11.283329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9554b-e023-4403-b6e1-e5397db6add6 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:57:11.291910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:57:11.293372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:57:11.293879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:57:11.294461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:57:11.299395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:57:11.324434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:57:11.326757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:57:11.356189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1231/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:57:25.955277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:57:25.956811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:57:25.985913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59297bf2-2f79-448b-86fc-669ce315fd6b service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:57:25.992177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:57:25.992840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:57:25.993382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:57:25.993994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:57:25.995765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:57:26.010492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:57:26.012170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:57:26.024018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1254/2485] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:58:03.885918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:58:03.895632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a2d2e-f541-4dc7-8412-ae64ffff2aea service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:58:03.900008 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:58:03.900644 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:58:03.900933 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:58:03.901213 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:58:03.903010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:58:03.975509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:58:03.976956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:58:03.991742 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1232/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:58:57.319123 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:58:57.330762 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780f867-67f2-492d-8366-d84b0e0e74ea service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:58:57.336284 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:58:57.336912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:58:57.337189 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:58:57.337460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:58:57.339236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:58:57.397161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:58:57.398782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:58:57.408661 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1255/2487] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:59:00.845319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:59:00.857623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22047f-87d4-46a8-ad2d-38acf4cf55bf service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:59:00.863096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:59:00.863725 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:59:00.864007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:59:00.864279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:59:00.866021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:59:00.922223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:59:00.923781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:59:00.932586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1233/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:59:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:59:03.356817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:59:03.367432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c0e62-807d-4605-9e64-3cc6f2d4a073 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:59:03.373115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b84df2-9204-4753-a362-25898819a003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:59:03.373837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b84df2-9204-4753-a362-25898819a003 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:59:03.374209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b84df2-9204-4753-a362-25898819a003 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:59:03.374567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b84df2-9204-4753-a362-25898819a003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:59:03.376386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-41b84df2-9204-4753-a362-25898819a003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:59:03.434146 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b84df2-9204-4753-a362-25898819a003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:59:03.436471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b84df2-9204-4753-a362-25898819a003 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:59:03.445037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1256/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:59:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:59:08.170922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:59:08.172297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:59:08.239345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6767ba-c195-41fb-8bee-9b21ddeff786 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:59:08.244369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:59:08.245007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:59:08.245290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:59:08.245567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:59:08.248172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:59:08.259545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:59:08.261121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:59:08.271548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1234/2490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:01:01.133680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b84df2-9204-4753-a362-25898819a003 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:01:01.143407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b84df2-9204-4753-a362-25898819a003 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:01:01.147000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:01:01.147634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:01:01.147917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:01:01.148198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:01:01.160982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:01:01.162532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:01:01.173709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1257/2491] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:01:03.957986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:01:03.968168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7dedb-dc90-4f49-b242-8fd3fbdc81ab service placement] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:01:03.971736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:01:03.972368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:01:03.972651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:01:03.972928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:01:03.982950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:01:03.984368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:01:03.995000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1235/2492] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:01:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:01:20.048386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:01:20.049753 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:01:20.062155 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544e2f-782a-4954-8b57-6329b85c7f8e service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:01:20.065630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:01:20.066294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:01:20.066577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:01:20.066852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:01:20.076858 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:01:20.078387 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:01:20.087213 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1258/2493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:01:21.671777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:01:21.683670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde356-3e8c-46ee-a5ba-2cee6642b9c2 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:01:21.689083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:01:21.689737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:01:21.690051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:01:21.690332 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:01:21.698926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:01:21.700503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:01:21.726869 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1236/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:01:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:02:04.183632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:02:04.191837 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6b721-76e7-4de0-bdbe-9a735c9ec5e9 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:02:04.195367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:02:04.196030 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:02:04.196315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:02:04.196587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:02:04.205069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:02:04.206564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:02:04.237117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1259/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:02:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:02:10.874501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:02:10.884552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8a1e9-861c-4cb8-b60b-f513412e8b80 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:02:10.888065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:02:10.888695 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:02:10.888975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:02:10.889248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:02:10.896207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:02:10.897617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:02:10.905424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1237/2496] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:03:12.276040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:03:12.289555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0c932-15e5-4b7a-9bee-2575238a4672 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:03:12.295951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:03:12.296611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:03:12.296894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:03:12.297171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:03:12.299545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:03:12.312918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:03:12.315200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:03:12.327988 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1260/2497] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:03:20.228402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:03:20.237689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefecf7-1305-4a0d-8f42-7915bc560f69 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:03:20.241166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:03:20.241786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:03:20.242094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:03:20.242367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:03:20.251136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:03:20.252546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:03:20.280676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1238/2498] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:03:58.245113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:03:58.285817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29436f-6750-44f4-9b97-164f019c96f3 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:03:58.291273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96387033-bd59-4012-af66-15d6384c040c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:03:58.291904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96387033-bd59-4012-af66-15d6384c040c service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:03:58.292183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96387033-bd59-4012-af66-15d6384c040c service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:03:58.292454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96387033-bd59-4012-af66-15d6384c040c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:03:58.300516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96387033-bd59-4012-af66-15d6384c040c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:03:58.302398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96387033-bd59-4012-af66-15d6384c040c service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:03:58.327771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1261/2499] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:04:00.428904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:04:00.488595 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a22c01-d679-4206-8896-f70501d4d539 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:04:00.494119 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:04:00.494751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:04:00.495031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:04:00.495304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:04:00.503583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:04:00.505191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:04:00.531956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1239/2500] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:04:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:04:04.463741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96387033-bd59-4012-af66-15d6384c040c service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:04:04.473422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96387033-bd59-4012-af66-15d6384c040c service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:04:04.477053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:04:04.477699 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:04:04.478007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:04:04.478286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:04:04.488966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:04:04.490442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:04:04.516726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1262/2501] 10.222.0.30 () {60 vars in 1396 bytes} [Tue Mar 8 15:04:04 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:04:16.166495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:04:16.167904 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:04:16.213447 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de50c0-302e-43df-8693-b83bcf48bc0f service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:04:16.219325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:04:16.219963 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:04:16.220244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:04:16.220523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:04:16.229137 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:04:16.230737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:04:16.241120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1240/2502] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:06:04.589304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:06:04.590875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:06:04.664012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae01a4-72ce-4513-8330-5c44960c5375 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:06:04.667617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:06:04.668246 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:06:04.668525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:06:04.668795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:06:04.670652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:06:04.748958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:06:04.751530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:06:04.762012 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1263/2503] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:06:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:06:04.802274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:06:04.811692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0b2d8-11a3-4c5a-8dbb-f0dfd5a87550 service placement] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:06:04.816488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:06:04.817118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:06:04.817402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:06:04.817680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:06:04.819578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:06:04.833303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:06:04.834685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:06:04.846591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1241/2504] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:06:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:07:13.831769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:07:13.833331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:07:13.906089 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ecbb7-5ee7-419f-a91f-f0cb2f8e0d12 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:07:13.909678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:07:13.910342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:07:13.910623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:07:13.910896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:07:13.913237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:07:13.922125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:07:13.923548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:07:13.931909 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1264/2505] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:07:20.649803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:07:20.658303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35504f37-9c63-4781-9bec-dda511647bbd service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:07:20.661877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:07:20.662517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:07:20.662795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:07:20.663069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:07:20.664975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:07:20.741244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:07:20.742718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:07:20.760581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1242/2506] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:07:20.822129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:07:20.830865 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b675b-a38d-4b3b-8b0d-07c9a800fb6b service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:07:20.834401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:07:20.835025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:07:20.835301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:07:20.835569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:07:20.837383 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:07:20.903152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:07:20.904565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:07:20.913345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1265/2507] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:07:20.956734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:07:20.965295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe92ea8-e27b-4361-9a8c-14147445d235 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:07:20.968829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:07:20.969456 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:07:20.969736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:07:20.970038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:07:20.971838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:07:21.038919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:07:21.040424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:07:21.049040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1243/2508] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:09:18.146354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:09:18.147932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:09:18.213002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd70e49-21a0-4d94-b9a6-beac6c4ebe76 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:09:18.218091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:09:18.218726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:09:18.219003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:09:18.219274 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:09:18.221084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:09:18.231975 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:09:18.233531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:09:18.242973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1266/2509] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:09:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:09:21.121471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:09:21.130331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4fe4f-aae1-494a-8ba7-72356e29a376 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:09:21.134760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:09:21.135403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:09:21.135761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:09:21.136009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:09:21.137975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:09:21.212226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:09:21.213682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:09:21.223207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1244/2510] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:09:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:09:21.374606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:09:21.384149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af8d2-5aaa-49a0-ace9-44b73ee2ffc4 service placement] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:09:21.387705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:09:21.388329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:09:21.388605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:09:21.388877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:09:21.390754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:09:21.458879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:09:21.460321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:09:21.469080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1267/2511] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:09:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:10:05.341770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:10:05.351100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90a6c-8ed0-4de7-9522-a5d6ed0480d1 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:10:05.355543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:10:05.356188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:10:05.356471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:10:05.356746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:10:05.358796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:10:05.435784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:10:05.437219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:10:05.446187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1245/2512] 10.222.0.30 () {60 vars in 1396 bytes} [Tue Mar 8 15:10:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:10:05.490771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:10:05.492385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:10:05.507473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a6bc7-34b3-4153-ac1c-c62d44c0dcc7 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:10:05.514135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:10:05.514800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:10:05.515081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:10:05.515353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:10:05.517187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:10:05.589415 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:10:05.591060 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:10:05.600630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1268/2513] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:10:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:11:21.541221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:11:21.543448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:11:21.554217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6f165-2c17-4bac-9800-3f702b0b92fc service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:11:21.558367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:11:21.559067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:11:21.559346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:11:21.559618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:11:21.569549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:11:21.570998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:11:21.581543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1246/2514] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:11:21.677760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:11:21.687080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0d253-b1ff-4c0f-8157-44c8f1ccdcd6 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:11:21.690644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:11:21.691283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:11:21.691565 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:11:21.691841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:11:21.702795 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:11:21.704335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:11:21.716221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1269/2515] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:12:21.529018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:12:21.538141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9640-6ac9-407d-a85c-b78cdcb4044e service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:12:21.541884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:12:21.542527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:12:21.542814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:12:21.543094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:12:21.550406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:12:21.551829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:12:21.559756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1247/2516] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:12:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:13:21.867001 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:13:21.875601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c06468-5e64-462d-9a6d-9c7d7ce04912 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:13:21.879823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:13:21.880791 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:13:21.881414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:13:21.881701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:13:21.892781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:13:21.894410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:13:21.903378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1270/2517] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:13:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:13:22.039587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:13:22.055885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8681-c6bd-45b9-aa15-b7d0196deb0e service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:13:22.060809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:13:22.062069 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:13:22.062355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:13:22.062851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:13:22.072527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:13:22.074122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:13:22.102556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1248/2518] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:13:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:13:22.152022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:13:22.161995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1169-8e5c-4906-a7af-77aae78f2bfb service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:13:22.166138 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:13:22.167065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:13:22.167479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:13:22.167972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:13:22.170539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:13:22.263883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:13:22.265321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:13:22.286420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1271/2519] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:13:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:13:22.412975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:13:22.426943 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3db22-912e-46b4-9a4b-a9afec0cb841 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:13:22.432998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:13:22.433636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:13:22.433959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:13:22.434519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:13:22.443402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:13:22.445206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:13:22.478922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1249/2520] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:13:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:14:22.796047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:14:22.798283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:14:22.877767 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7830e7b-1c5c-4ae5-b259-ac5df2d90606 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:14:22.882788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:14:22.883419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:14:22.883693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:14:22.883962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:14:22.892745 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:14:22.894341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:14:22.903855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1272/2521] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:14:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:15:15.251082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:15:15.252503 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:15:15.273273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f497431-2d9c-40c3-8505-eff9d17b1adf service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:15:15.276811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:15:15.277440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:15:15.277719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:15:15.278026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:15:15.286617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:15:15.288029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:15:15.315001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1250/2522] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:15:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:15:22.930684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:15:22.940517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1bfd6-fea7-422c-af77-a7581023a40f service placement] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:15:22.944104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:15:22.944746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:15:22.945028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:15:22.945299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:15:22.954322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:15:22.956312 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:15:22.989240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1273/2523] 10.222.0.30 () {60 vars in 1396 bytes} [Tue Mar 8 15:15:22 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:15:23.035191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:15:23.039158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:15:23.045000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac818d-c460-4ba7-9634-c0a338729d43 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:15:23.054939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:15:23.055594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:15:23.055880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:15:23.056161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:15:23.065404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:15:23.066873 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:15:23.067632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079af39-4194-4418-84b2-74aaf7a72708 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:15:23.073152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:15:23.073779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:15:23.074093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:15:23.074358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:15:23.083019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:15:23.084601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:15:23.095752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1251/2524] 10.222.0.30 () {60 vars in 1396 bytes} [Tue Mar 8 15:15:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:15:23.111846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1274/2525] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:15:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:17:23.766505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:17:23.828755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c4d4-95fd-4b74-9059-0606dc5c60e0 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:17:23.832400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:17:23.833038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:17:23.833318 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:17:23.833596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:17:23.835483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:17:23.916648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:17:23.918199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:17:23.928881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1252/2526] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:17:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:17:23.969730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:17:23.979920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ff7d-003e-4548-a98e-8026553fb155 service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:17:23.983665 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:17:23.984304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:17:23.984585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:17:23.984861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:17:23.986810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:17:24.001643 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:17:24.003163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:17:24.015670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1275/2527] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:17:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:17:24.816312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:17:24.880836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7897-0d4a-4184-ba9d-b9d695c5f698 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:17:24.884697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:17:24.885379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:17:24.885667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:17:24.885980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:17:24.887913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:17:24.913415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:17:24.916091 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:17:24.927484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1253/2528] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:17:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:19:24.550153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:24.559989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:24.560418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d923-356f-4cac-abac-6c6d8e42f33e service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:24.561013 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:24.564048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:24.564684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.564958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.565228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.567270 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:24.580058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705970-0dc3-4e66-9414-d11817623eba service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:24.588404 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:24.589166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.589517 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.590036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.591964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:24.605415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:24.607536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:24.621511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1254/2529] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:19:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:19:24.659737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:24.661234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:24.669723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:24.684868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01659-6db2-4b12-bbfd-5428d9d7e1e7 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:24.694428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1276/2530] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:19:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:19:24.700159 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:24.700813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.701092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.701369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.703272 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:24.781337 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:24.782971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:24.793661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1255/2531] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:19:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:19:26.132198 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.133743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:26.199536 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce2c5-b8e4-4337-a3b5-1d012947d4e8 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.204416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.205055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.205332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.205620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.207474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:26.218663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:26.220280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:26.230554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1277/2532] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:20:07.311830 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:07.327384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f13fe-bfd6-4bb5-9415-a737bee337e4 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:07.334565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:07.335217 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.335507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.335785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.337733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:07.411377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:07.413223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:07.423166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1256/2533] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:20:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:21:25.050891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.052424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:25.075673 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d52930-9f09-41f5-a1bc-a3dd1c6ebbea service placement] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.079827 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.080459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.080737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.081005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.082912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:25.151686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.153125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.162219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1278/2534] 10.222.0.30 () {60 vars in 1396 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:21:25.303029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.311798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82758f-25ce-42fe-af21-eeeb357b3b72 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.316081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.316706 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.316986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.317261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.319114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:25.387537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.388972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.397786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1257/2535] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:21:25.445086 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.453062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde373-695c-4c18-b43e-f590ccf4a0ae service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.456933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.457554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.457830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.458128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.459929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:25.529610 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.531087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.539994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1279/2536] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:22:07.563130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:07.564698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:07.576117 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ee24-99dc-4731-8b89-adc6c94d2e5a service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:07.579792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:07.580430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:07.580711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:07.580986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:07.583215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:07.652872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:07.654347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:07.663580 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1258/2537] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:22:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:22:31.496358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:31.505678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da432-e7c5-4a63-8431-0f59a179ca28 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:31.509178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:31.509802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:31.510117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:31.510418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:31.517117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:31.518557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:31.526557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1280/2538] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:22:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:23:25.611971 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:25.620761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a332-26d8-4782-bc31-87b8869beb81 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:25.624295 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:25.624922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:25.625200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:25.625469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:25.635228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:25.636630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:25.647507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1259/2539] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:23:25.687498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:25.696393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208dae-4de9-40ef-8c94-1933e6675094 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:25.699855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:25.700590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:25.700798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:25.701066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:25.712153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:25.713575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:25.726921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1281/2540] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:23:26.706667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:26.708981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:26.721522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ea91-c83d-4585-b8d6-5a1653385827 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:26.727384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:26.728677 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:26.728969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:26.729247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:26.729706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:26.733090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:26.742896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdada2e6-9946-445b-af77-70ba8559e771 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:26.747139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:26.748016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:26.748470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:26.748905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:26.752698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:26.830067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:26.832730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:26.839803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:26.841257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:26.861399 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1282/2541] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:23:26.866056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1260/2542] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:23:35.833426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:35.837615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:35.851283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271db4e-d518-4ce9-a676-c3a6d9d88942 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:35.856223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:35.857067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:35.857282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:35.857549 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] PATH_INFO: `/v3/users/86a6549a475a4cbe803ab5bed1c91e51` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:35.858748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a6549a475a4cbe803ab5bed1c91e51)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:35.860851 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:35.907953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a6549a475a4cbe803ab5bed1c91e51'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:35.915621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a6549a475a4cbe803ab5bed1c91e51'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:35.927551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a6549a475a4cbe803ab5bed1c91e51'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:35.928209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a6549a475a4cbe803ab5bed1c91e51'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:35.935296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a6549a475a4cbe803ab5bed1c91e51'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:35.942540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1283/2543] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:23:35 2022] DELETE /identity/v3/users/86a6549a475a4cbe803ab5bed1c91e51 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:36.152689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:36.163453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46515f-c126-4b26-87d4-c079c5ee5bdf service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:36.237387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:36.238823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:36.239134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:36.239413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] PATH_INFO: `/v3/projects/d8469a7d8671451eb029d18b67e7f76d` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:36.241384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8469a7d8671451eb029d18b67e7f76d)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:36.243377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:36.321389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8469a7d8671451eb029d18b67e7f76d', 'request_id': 'req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.333611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8469a7d8671451eb029d18b67e7f76d', 'request_id': 'req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.342767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8469a7d8671451eb029d18b67e7f76d', 'request_id': 'req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.358041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] The token cache is being invalidate because project d8469a7d8671451eb029d18b67e7f76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:23:36.358312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.359509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.376544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1261/2544] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:23:36 2022] DELETE /identity/v3/projects/d8469a7d8671451eb029d18b67e7f76d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:36.380675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:36.382193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:36.402507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fda15-a249-467a-a18d-862a38829cda admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:36.520346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:36.521486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:36.521768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:36.522067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] PATH_INFO: `/v3/users/b2df75fe21084ff6a4ce28f53e0c0af5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:36.542065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2df75fe21084ff6a4ce28f53e0c0af5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:36.544176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:36.604593 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2df75fe21084ff6a4ce28f53e0c0af5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.621422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2df75fe21084ff6a4ce28f53e0c0af5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.640538 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2df75fe21084ff6a4ce28f53e0c0af5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.641272 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2df75fe21084ff6a4ce28f53e0c0af5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.650463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2df75fe21084ff6a4ce28f53e0c0af5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.663980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1284/2545] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:23:36 2022] DELETE /identity/v3/users/b2df75fe21084ff6a4ce28f53e0c0af5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:36.694403 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:36.695807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:36.715247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19d2f1-a424-467c-9c1c-c6d8a3f7ef6a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:36.773386 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:36.774298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:36.774581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:36.774851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] PATH_INFO: `/v3/users/d5eebbc0c8574cd58c022f2cc0e9f1eb` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:36.776059 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5eebbc0c8574cd58c022f2cc0e9f1eb)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:36.778022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:36.831568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5eebbc0c8574cd58c022f2cc0e9f1eb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.840153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5eebbc0c8574cd58c022f2cc0e9f1eb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.852583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5eebbc0c8574cd58c022f2cc0e9f1eb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.853297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5eebbc0c8574cd58c022f2cc0e9f1eb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.853905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5eebbc0c8574cd58c022f2cc0e9f1eb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:36.867990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1262/2546] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:23:36 2022] DELETE /identity/v3/users/d5eebbc0c8574cd58c022f2cc0e9f1eb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:36.869829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:36.871516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:36.885338 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ca0ba-a852-406b-ab47-71d99d1288c1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:36.943577 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:36.944017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:36.944299 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:36.944573 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] PATH_INFO: `/v3/projects/deaef75ee29a4ba8bbc186e18d9b111c` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:36.960493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deaef75ee29a4ba8bbc186e18d9b111c)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:36.962395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:37.015608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deaef75ee29a4ba8bbc186e18d9b111c', 'request_id': 'req-a2a13b02-d429-46ac-9282-f16d39b03e73'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.026574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deaef75ee29a4ba8bbc186e18d9b111c', 'request_id': 'req-a2a13b02-d429-46ac-9282-f16d39b03e73'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.038309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deaef75ee29a4ba8bbc186e18d9b111c', 'request_id': 'req-a2a13b02-d429-46ac-9282-f16d39b03e73'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.053351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] The token cache is being invalidate because project deaef75ee29a4ba8bbc186e18d9b111c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:23:37.053642 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.054314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.055884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1285/2547] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:23:36 2022] DELETE /identity/v3/projects/deaef75ee29a4ba8bbc186e18d9b111c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:37.072036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:37.073724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:37.089638 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29980e8-d09f-49c6-975a-aaad537f1308 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:37.163445 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:37.165293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:37.165579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:37.165883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] PATH_INFO: `/v3/projects/6ce506c63f16445cac166f16104398cd` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:37.167388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce506c63f16445cac166f16104398cd)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:37.169335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:37.232547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce506c63f16445cac166f16104398cd', 'request_id': 'req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.240960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce506c63f16445cac166f16104398cd', 'request_id': 'req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.248238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce506c63f16445cac166f16104398cd', 'request_id': 'req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.259443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] The token cache is being invalidate because project 6ce506c63f16445cac166f16104398cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:23:37.259776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.260380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.261948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1263/2548] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:23:37 2022] DELETE /identity/v3/projects/6ce506c63f16445cac166f16104398cd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:37.266052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:37.267468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:37.280702 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a13b02-d429-46ac-9282-f16d39b03e73 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:37.337041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:37.337942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:37.338228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:37.338504 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] PATH_INFO: `/v3/users/dee058bc1b304379b06f5f7f05e007a9` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:37.351470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee058bc1b304379b06f5f7f05e007a9)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:37.353406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:37.397741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee058bc1b304379b06f5f7f05e007a9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.405100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee058bc1b304379b06f5f7f05e007a9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.416542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee058bc1b304379b06f5f7f05e007a9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.417169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee058bc1b304379b06f5f7f05e007a9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.423608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee058bc1b304379b06f5f7f05e007a9'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.429407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1286/2549] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:23:37 2022] DELETE /identity/v3/users/dee058bc1b304379b06f5f7f05e007a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:37.603146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:37.604552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:37.621317 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3fb24-7c9d-4a31-bdf1-3816b6c36858 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:37.677099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:37.677992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:37.678273 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:37.678544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] PATH_INFO: `/v3/projects/8ff63744c7e544d6b97ee26825261929` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:37.688453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff63744c7e544d6b97ee26825261929)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:37.690379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:37.734277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff63744c7e544d6b97ee26825261929', 'request_id': 'req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.741539 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff63744c7e544d6b97ee26825261929', 'request_id': 'req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.748123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff63744c7e544d6b97ee26825261929', 'request_id': 'req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.759309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] The token cache is being invalidate because project 8ff63744c7e544d6b97ee26825261929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:23:37.759589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.760215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:23:37.761807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1264/2550] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:23:37 2022] DELETE /identity/v3/projects/8ff63744c7e544d6b97ee26825261929 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:24:07.698569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:07.699947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:07.755595 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ced34-ec8f-45d1-9873-e21c21d4e867 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:07.802250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:07.802899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:07.803175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:07.803445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:07.805214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:07.885659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:07.887110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:07.905558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1287/2551] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:24:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:24:31.108778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:31.110198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:31.233878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b55ce-8f22-4e4f-b9d9-8d2d214d8480 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:31.239038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:31.239676 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:31.239959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:31.240237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:31.242051 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:31.253573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:31.255548 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:31.265111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1265/2552] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:24:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:25:07.859240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:25:07.860718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:25:07.968241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b179ea0-5810-4de0-943d-48a2469e1c8b service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:25:07.974176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:25:07.974822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:25:07.975104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:25:07.975380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:25:07.977128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:25:08.041416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:25:08.043058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:25:08.060617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1288/2553] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:25:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:25:25.881004 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:25:25.882526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:25:25.904609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c74b6f-401c-498c-a1bf-20618975d6c6 service placement] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:25:25.908436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:25:25.910303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:25:25.910593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:25:25.910872 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:25:25.912787 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:25:25.981255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:25:25.982733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfc29c-19f8-40dc-9f52-b4547fc9c297 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:25:26.000698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1266/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:25:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:04.756747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:04.758625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:04.787024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b467c-8573-45cc-ae84-8bb4f6e569ec service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:04.792613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:04.793319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:04.793605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:04.793894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:04.796107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:04.869380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:04.875777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:04.895221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1289/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:05.377905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:05.378424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:05.378544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:05.446125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:05.447993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:05.521537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1267/2556] 10.222.0.30 () {58 vars in 967 bytes} [Tue Mar 8 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:05.573153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:05.574670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:05.675436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96b3c4-5dc7-48dd-8202-97a8d09acd29 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:05.681955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:05.682944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:05.684149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:05.684809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:05.694921 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:05.696520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:05.705556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1290/2557] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:26:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:06.244690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:06.246181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:06.313215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0e6b1-b217-4908-94a5-dddfa902e64b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:06.318006 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:06.318662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:06.319036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:06.319264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:06.321324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:06.397247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:06.398964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:06.426972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1268/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:07.077114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:07.079560 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:07.094476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d901e-7097-4ab2-93c5-60b282c293aa service swift] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:07.099488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:07.100153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:07.100437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:07.100712 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:07.103157 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:07.117905 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:07.119722 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14adbd-ebcd-4e65-a9f2-2a437e192438 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:07.131040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1291/2559] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:08.682579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:08.713975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f830351-dd06-43ae-8c57-648a8835b321 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:08.723610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:08.724909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:08.725781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:08.726622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:08.733988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:08.749605 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:08.752153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:08.775744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1269/2560] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:08.916008 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:08.916941 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:08.917430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:08.955686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] MFA Rules not processed for user `1775260bd3f947ea85d14b3a1aa80b38`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:08.957726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:08.964996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1292/2561] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:09.551180 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:09.569692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076518-a2b0-4621-89c3-cd6ae4bc9acd service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:09.575829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:09.576899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:09.577356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:09.577783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:09.580640 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:09.593465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:09.596176 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:09.606849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1270/2562] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:10.244502 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:10.248044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:10.283154 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0e250-2d29-4f39-a42d-3d6e0bb0ed9b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:10.291663 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:10.292776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:10.293266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:10.293816 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:10.298152 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:10.322579 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:10.325385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:10.344728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1293/2563] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:13.695163 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:13.696952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:13.715927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2f933-d6b5-40f6-a075-091105d4842a service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:13.726459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:13.728103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:13.729433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:13.730079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] PATH_INFO: `/v3/users/51ed61d0a16d465889c0474a4d2b7dee` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:13.742270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ed61d0a16d465889c0474a4d2b7dee)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:13.742270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:13.866851 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ed61d0a16d465889c0474a4d2b7dee'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:13.885448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ed61d0a16d465889c0474a4d2b7dee'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:13.907586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ed61d0a16d465889c0474a4d2b7dee'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:13.909071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ed61d0a16d465889c0474a4d2b7dee'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:13.910429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3c6f32e4-592c-4723-a6a6-7b595d940ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ed61d0a16d465889c0474a4d2b7dee'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:13.947135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1271/2564] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:13 2022] DELETE /identity/v3/users/51ed61d0a16d465889c0474a4d2b7dee => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:14.378315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:14.393953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90359-5c18-45a2-8b47-b5804b8fcf5d service placement] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:14.462044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:14.463288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.463796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.464278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] PATH_INFO: `/v3/projects/3f98f6f0a9d945e88b01a9da19044aa1` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.465819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f98f6f0a9d945e88b01a9da19044aa1)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:14.467980 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:14.518777 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f98f6f0a9d945e88b01a9da19044aa1', 'request_id': 'req-c9122045-5542-44e0-80e1-ac381255c5e4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:14.527814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f98f6f0a9d945e88b01a9da19044aa1', 'request_id': 'req-c9122045-5542-44e0-80e1-ac381255c5e4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:14.536059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f98f6f0a9d945e88b01a9da19044aa1', 'request_id': 'req-c9122045-5542-44e0-80e1-ac381255c5e4'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:14.547545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] The token cache is being invalidate because project 3f98f6f0a9d945e88b01a9da19044aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:14.547840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:14.549248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c9122045-5542-44e0-80e1-ac381255c5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:14.556934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.557348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.557730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.559622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1294/2565] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:14 2022] DELETE /identity/v3/projects/3f98f6f0a9d945e88b01a9da19044aa1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:14.615886 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:14.617104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:14.690003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1272/2566] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:14.693693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.694109 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.694486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.713121 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:14.714371 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:14.723564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1295/2567] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:14.727322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:14.737693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f81cac-7ce9-4df0-935a-0908d8172887 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:14.742264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:14.742917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.744646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.744932 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.745659 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:26:14.745987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:14.747685 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:14.761358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1273/2568] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:26:14.765438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:14.775639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eefc3-3b09-4c87-956a-54bca1ada71a None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:14.780872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:14.781692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.782076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.782430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.783855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:14.786481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:14.824447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1296/2569] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:14 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:14.828643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:14.839367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5db5-5510-4f3c-b0e8-98b6cdc9d63f admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:14.910476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:14.911266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.911551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.912005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.913303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:14.915607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:14.942483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1274/2570] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:14 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:14.950467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:14.962464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c9ee-d273-49c4-a007-671ab52d7f58 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:14.967394 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:14.968130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:14.968411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:14.968678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:14.969407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:14.972084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:14.983992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1297/2571] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:14.988120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:15.000035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709fbcc-096b-440e-bfdc-118f3b5372d7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:15.006240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ae948-fab2-43b1-94ec-5922d3564d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:15.006925 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ae948-fab2-43b1-94ec-5922d3564d61 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:15.007207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ae948-fab2-43b1-94ec-5922d3564d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:15.007484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ae948-fab2-43b1-94ec-5922d3564d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:15.008210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ae948-fab2-43b1-94ec-5922d3564d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:15.009825 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ae948-fab2-43b1-94ec-5922d3564d61 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:15.021846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1275/2572] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:15.025973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:15.036461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2c8b8-1c93-439b-94d5-8425d5a9b077 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:15.040945 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:15.041826 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:15.042137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:15.042405 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] PATH_INFO: `/v3/projects/e4bf1dc206f041ca91a40149aab30dee/users/282b16dbcb1648c39afa0f7ed2d5dbda/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:15.057143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bf1dc206f041ca91a40149aab30dee, user_id=282b16dbcb1648c39afa0f7ed2d5dbda, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:15.059845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:15.074131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1298/2573] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:15 2022] PUT /identity/v3/projects/e4bf1dc206f041ca91a40149aab30dee/users/282b16dbcb1648c39afa0f7ed2d5dbda/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:15.079433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:15.081735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:15.081735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:15.104587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:15.106453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:15.183186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1276/2574] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:15.194175 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:15.195883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:15.265805 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf7f6-4118-4cfd-ac5d-d4f7b0119854 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:15.269741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:15.270427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:15.270707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:15.270979 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:15.281534 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:15.284021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:15.294726 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1299/2575] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:16.310111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:16.312280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:16.326348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a7358-ed35-409e-8ddf-a964b3f41238 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:16.332029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:16.332978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:16.333651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:16.333748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] PATH_INFO: `/v3/users/b6c5fac3bd10428d87723eaf90bcbfac` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:16.335104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c5fac3bd10428d87723eaf90bcbfac)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:16.337286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:16.393632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c5fac3bd10428d87723eaf90bcbfac'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.404686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c5fac3bd10428d87723eaf90bcbfac'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.421597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c5fac3bd10428d87723eaf90bcbfac'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.422598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c5fac3bd10428d87723eaf90bcbfac'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.424270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c5fac3bd10428d87723eaf90bcbfac'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.446182 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1277/2576] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:16 2022] DELETE /identity/v3/users/b6c5fac3bd10428d87723eaf90bcbfac => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:16.728916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:16.745535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23eea3-9e43-418b-845c-1c1f7cb86eea service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:16.840278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:16.841641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:16.842170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:16.842691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] PATH_INFO: `/v3/projects/3ecfade47630412b85598218c7c04664` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:16.866796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecfade47630412b85598218c7c04664)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:16.869025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:16.940834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecfade47630412b85598218c7c04664', 'request_id': 'req-207c9d01-1b1a-492b-98ba-7125c13ca859'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.956326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecfade47630412b85598218c7c04664', 'request_id': 'req-207c9d01-1b1a-492b-98ba-7125c13ca859'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.967732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecfade47630412b85598218c7c04664', 'request_id': 'req-207c9d01-1b1a-492b-98ba-7125c13ca859'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.986476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] The token cache is being invalidate because project 3ecfade47630412b85598218c7c04664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:16.987373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.988779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:16.994084 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1300/2577] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:16 2022] DELETE /identity/v3/projects/3ecfade47630412b85598218c7c04664 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:16.995043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:16.996487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:17.011499 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054c3f-6bcb-48be-b4a3-00c9705a1a26 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:17.094664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:17.096583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:17.097143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:17.097721 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] PATH_INFO: `/v3/users/5f8babd08def4407996f00f3abc16017` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:17.122854 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8babd08def4407996f00f3abc16017)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:17.125435 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:17.241488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8babd08def4407996f00f3abc16017'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.250732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8babd08def4407996f00f3abc16017'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.268406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8babd08def4407996f00f3abc16017'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.269421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8babd08def4407996f00f3abc16017'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.270129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8babd08def4407996f00f3abc16017'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.284792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1278/2578] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:16 2022] DELETE /identity/v3/users/5f8babd08def4407996f00f3abc16017 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:17.710353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:17.712056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:17.725812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c9d01-1b1a-492b-98ba-7125c13ca859 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:17.756543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:17.758027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:17.837237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:17.838721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:17.839163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:17.839625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] PATH_INFO: `/v3/users/240aab1005904d37b1ed9eb6ba87d32d` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:17.841082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] RBAC: Authorizing `identity:delete_user(user_id=240aab1005904d37b1ed9eb6ba87d32d)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:17.844181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:17.852007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270bdeb-04a5-42c9-9717-f8ff5adaf7cc admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:17.857304 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:17.858322 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:17.858674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:17.859024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] PATH_INFO: `/v3/projects/5464d798d7924c0cb4bf034d1347235a` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:17.874546 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5464d798d7924c0cb4bf034d1347235a)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:17.880439 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:17.936564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5464d798d7924c0cb4bf034d1347235a', 'request_id': 'req-66b458cd-fbb8-491e-a51c-4aae6a872505'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.950678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5464d798d7924c0cb4bf034d1347235a', 'request_id': 'req-66b458cd-fbb8-491e-a51c-4aae6a872505'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.960723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5464d798d7924c0cb4bf034d1347235a', 'request_id': 'req-66b458cd-fbb8-491e-a51c-4aae6a872505'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.961617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240aab1005904d37b1ed9eb6ba87d32d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.976186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] The token cache is being invalidate because project 5464d798d7924c0cb4bf034d1347235a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:17.976616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.977586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-66b458cd-fbb8-491e-a51c-4aae6a872505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.980204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240aab1005904d37b1ed9eb6ba87d32d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:17.984345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1279/2579] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:17 2022] DELETE /identity/v3/projects/5464d798d7924c0cb4bf034d1347235a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:18.047527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240aab1005904d37b1ed9eb6ba87d32d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:18.048855 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240aab1005904d37b1ed9eb6ba87d32d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:18.057842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240aab1005904d37b1ed9eb6ba87d32d'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:18.066739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1301/2580] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:17 2022] DELETE /identity/v3/users/240aab1005904d37b1ed9eb6ba87d32d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:18.071383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:18.072038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:18.072507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:18.116168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:18.119466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:18.238990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1280/2581] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:18.259071 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:18.260529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:18.366083 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5277f54-b79b-4573-a4cb-70590ab0deff admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:18.371285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:18.372746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:18.373115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:18.373489 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:18.414904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:18.418548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:18.447327 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1302/2582] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:19.024581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:19.026744 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:19.054699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437819a-8fd9-460b-9a67-fefabf000de9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:19.065837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:19.066881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:19.068199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:19.068935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] PATH_INFO: `/v3/projects/1d7d3583d67848789b9bbab1e037d35f` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:19.073486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7d3583d67848789b9bbab1e037d35f)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:19.076141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:19.153482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7d3583d67848789b9bbab1e037d35f', 'request_id': 'req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.165591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7d3583d67848789b9bbab1e037d35f', 'request_id': 'req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.179116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7d3583d67848789b9bbab1e037d35f', 'request_id': 'req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.201206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] The token cache is being invalidate because project 1d7d3583d67848789b9bbab1e037d35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:19.201897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.202939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.206939 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1281/2583] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:19 2022] DELETE /identity/v3/projects/1d7d3583d67848789b9bbab1e037d35f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:19.210861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:19.231036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e428cc-3128-4fb1-b526-40d809d3e0c2 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:19.339268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:19.340388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:19.340871 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:19.341315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] PATH_INFO: `/v3/users/aec4163426de404fb7dd478e7c00aaeb` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:19.343557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec4163426de404fb7dd478e7c00aaeb)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:19.346258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:19.451048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec4163426de404fb7dd478e7c00aaeb'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.472317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec4163426de404fb7dd478e7c00aaeb'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.502592 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec4163426de404fb7dd478e7c00aaeb'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.503596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec4163426de404fb7dd478e7c00aaeb'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.521375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-1b005f04-cd72-40d0-a4df-3309c38aadda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec4163426de404fb7dd478e7c00aaeb'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:19.531641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1303/2584] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:19 2022] DELETE /identity/v3/users/aec4163426de404fb7dd478e7c00aaeb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:19.946570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:19.953200 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:19.971250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd96f9-0443-4f11-86cf-a3a40b87e4b6 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.047010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.054448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.054816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.055166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] PATH_INFO: `/v3/projects/8d42a73f76cb47599c4b8bff196a5001` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.056711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d42a73f76cb47599c4b8bff196a5001)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.058906 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.119306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d42a73f76cb47599c4b8bff196a5001', 'request_id': 'req-4a9adf15-7a08-4b27-bc8c-f17318dd764a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:20.131809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d42a73f76cb47599c4b8bff196a5001', 'request_id': 'req-4a9adf15-7a08-4b27-bc8c-f17318dd764a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:20.140189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d42a73f76cb47599c4b8bff196a5001', 'request_id': 'req-4a9adf15-7a08-4b27-bc8c-f17318dd764a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:20.160033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] The token cache is being invalidate because project 8d42a73f76cb47599c4b8bff196a5001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:20.160339 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:20.161646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4a9adf15-7a08-4b27-bc8c-f17318dd764a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:20.164150 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1282/2585] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:19 2022] DELETE /identity/v3/projects/8d42a73f76cb47599c4b8bff196a5001 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:20.175079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.175438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.175897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.195393 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:20.197350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:20.276078 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1304/2586] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:20.284805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.285222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.285610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.314355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:20.315707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:20.324616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1283/2587] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:20.329249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:20.350093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a917bf-6136-48fd-85de-cfd5ca1c1437 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.364888 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.365611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.370556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.370843 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.371598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:26:20.371906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.373586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.386690 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1305/2588] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:26:20.391197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:20.402526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150a623-a79e-4eb5-bca7-3123f7cbf448 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.409912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.410845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.411467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.411896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.412736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.415862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.455102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:20.455293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1284/2589] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:20 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:20.466686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27577f-cee9-4863-8ea1-4fd3003d6ca7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.539800 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.540474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.540972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.541248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.541969 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.544061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.581904 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1306/2590] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:20 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:20.588082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:20.602727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e72a1-c10e-46e0-a4f0-fbc9cf4c424a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.608010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.609250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.609531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.610058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.611584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.613214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.630226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1285/2591] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:20.634362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:20.652224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26402d-10a8-44f7-9e73-88f9407a5cc3 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.675233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efe3b9-1c3f-4c96-8e5e-9318049f0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.675825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efe3b9-1c3f-4c96-8e5e-9318049f0796 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.676108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efe3b9-1c3f-4c96-8e5e-9318049f0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.676381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efe3b9-1c3f-4c96-8e5e-9318049f0796 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.677115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efe3b9-1c3f-4c96-8e5e-9318049f0796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.683402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efe3b9-1c3f-4c96-8e5e-9318049f0796 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.715043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1307/2592] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:20.719508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:20.743525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf22bef-40b0-4374-b88e-2c373977b30a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:20.760574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:20.761479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.761759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.762057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] PATH_INFO: `/v3/projects/992e2dbe380f4690a71d4c96549f1541/users/fd1f170b4e0b46468f5debae1d79c9c3/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.815281 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992e2dbe380f4690a71d4c96549f1541, user_id=fd1f170b4e0b46468f5debae1d79c9c3, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:20.818299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:20.863429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1286/2593] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:20 2022] PUT /identity/v3/projects/992e2dbe380f4690a71d4c96549f1541/users/fd1f170b4e0b46468f5debae1d79c9c3/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:20.874243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141ef19-ab8d-4fc3-aa2f-b50b901c4bb3 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:20.874488 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141ef19-ab8d-4fc3-aa2f-b50b901c4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:20.874799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141ef19-ab8d-4fc3-aa2f-b50b901c4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:20.962042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6141ef19-ab8d-4fc3-aa2f-b50b901c4bb3 None None] MFA Rules not processed for user `fd1f170b4e0b46468f5debae1d79c9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:20.963511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6141ef19-ab8d-4fc3-aa2f-b50b901c4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.139850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1308/2594] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:21.145334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.244739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.245117 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.245475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.263986 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3618480-7534-4e84-99e9-50a9ff157b64 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.270444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.271198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.271837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.272292 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.273231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.275413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.296421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] MFA Rules not processed for user `282b16dbcb1648c39afa0f7ed2d5dbda`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:21.297922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.312045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1287/2595] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:21 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:21.316702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.392406 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1309/2596] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:21.401598 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.403033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.405244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923601a-4ab4-4998-b7af-2eaffc6e53a7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.410160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.411092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.411560 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.412591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.413462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.415622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.437122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1288/2597] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:21 2022] POST /identity/v3/users => generated 306 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:21.442942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.453912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6af2-4544-4529-a41f-bc7571107130 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.460763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.461565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.462201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.462488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.463338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.465026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.482778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1289/2598] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:21.483868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.496458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c37f05-8f3d-45e9-8668-9f8f7b8cd5d4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.497742 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2575b-3b52-4450-9377-057622afcf94 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.501723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.502891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.503384 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.503838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] PATH_INFO: `/v3/projects/860b6172dd9143228a19c0b0e579757e/users/c85ae235338b4633ac57542b9c23bca8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.521123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860b6172dd9143228a19c0b0e579757e, user_id=c85ae235338b4633ac57542b9c23bca8, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.524312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.540874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1290/2599] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:21 2022] PUT /identity/v3/projects/860b6172dd9143228a19c0b0e579757e/users/c85ae235338b4633ac57542b9c23bca8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:21.542111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.544203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.578325 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.579014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.579878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.580158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.619286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0dc62-afac-44ea-94b8-5f3d8f6d2564 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.625175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.625829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.626189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.626667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.628584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.635669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.637285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.640674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.642751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.646773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1310/2600] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:26:21.647572 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.653455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1291/2601] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:21.658040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba2979-0749-4563-a9fd-f2402357f1ae service nova] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.717396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49632ccc-ba29-47e2-98ed-086b916f65e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.718080 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632ccc-ba29-47e2-98ed-086b916f65e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.718362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632ccc-ba29-47e2-98ed-086b916f65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.718635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49632ccc-ba29-47e2-98ed-086b916f65e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.719380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49632ccc-ba29-47e2-98ed-086b916f65e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.721201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49632ccc-ba29-47e2-98ed-086b916f65e1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.731131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1311/2602] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:21.735476 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.745796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac2ef3-e0bb-45d4-ba4f-22d3be4f2436 service nova] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.750402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.752157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.752443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.752715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] PATH_INFO: `/v3/projects/860b6172dd9143228a19c0b0e579757e/users/c85ae235338b4633ac57542b9c23bca8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.754730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860b6172dd9143228a19c0b0e579757e, user_id=c85ae235338b4633ac57542b9c23bca8, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.757329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.768260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1292/2603] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:21 2022] PUT /identity/v3/projects/860b6172dd9143228a19c0b0e579757e/users/c85ae235338b4633ac57542b9c23bca8/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:21.782116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.783691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.783894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.814627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] MFA Rules not processed for user `c85ae235338b4633ac57542b9c23bca8`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:21.815792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.889896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1312/2604] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:26:21.900776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:21.902536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:21.969377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312342f6-837f-48fb-8249-ca397af87df0 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:21.974245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83979-d08f-41a0-b46a-7fca75eda7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:21.975009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83979-d08f-41a0-b46a-7fca75eda7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:21.975296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83979-d08f-41a0-b46a-7fca75eda7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:21.975574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83979-d08f-41a0-b46a-7fca75eda7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:21.987231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c83979-d08f-41a0-b46a-7fca75eda7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:21.987515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c83979-d08f-41a0-b46a-7fca75eda7c1 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:21.999822 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1293/2605] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:22.087613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:22.099505 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ad969-166f-4d21-9f07-50632927eb93 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:22.104377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:22.104377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:22.104377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:22.114335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:22.189818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:22.191430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:22.201707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1313/2606] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:23.438909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:23.440799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:23.441153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:23.476134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] MFA Rules not processed for user `282b16dbcb1648c39afa0f7ed2d5dbda`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:23.477455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:23.549799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1294/2607] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:25.574822 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:25.584026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7de4-119a-4b18-b262-e6c7929e9d1c service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:25.587687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:25.588316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:25.588594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:25.588866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:25.590687 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:25.657815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:25.659330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:25.676423 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1314/2608] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:28.969267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:29.053112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd955-6512-41ec-a6bc-fc13e57672e4 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:29.058708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:29.059357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:29.059637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:29.059912 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:29.061827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:29.074816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:29.076421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06b0c2-80fa-4fbb-aa39-0a0c74de6bf2 service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:29.087826 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1295/2609] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:29.733493 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:29.799908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616da9e-f38e-47f6-9ffc-08c32e1c6b68 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:29.804501 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:29.805381 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:29.805891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:29.806596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] PATH_INFO: `/v3/users/fd1f170b4e0b46468f5debae1d79c9c3` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:29.807820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1f170b4e0b46468f5debae1d79c9c3)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:29.809776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:29.856965 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1f170b4e0b46468f5debae1d79c9c3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:29.865985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1f170b4e0b46468f5debae1d79c9c3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:29.880002 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1f170b4e0b46468f5debae1d79c9c3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:29.880802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1f170b4e0b46468f5debae1d79c9c3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:29.887485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1f170b4e0b46468f5debae1d79c9c3'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:29.893821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1315/2610] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:29 2022] DELETE /identity/v3/users/fd1f170b4e0b46468f5debae1d79c9c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:29.899248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:29.899576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:29.899942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:29.917919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:29.919112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:29.982754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1296/2611] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:29.993518 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:29.995341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:30.054092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbdb62-72c9-41bd-98a5-e1255de97957 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:30.058202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:30.058943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:30.059320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:30.059708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:30.070644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:30.072485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:30.083958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1316/2612] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:30.470551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:30.472284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:30.491223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24a69b-5f4f-487e-8d31-e74299a2f581 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:30.496784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:30.498170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:30.498512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:30.498907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] PATH_INFO: `/v3/projects/992e2dbe380f4690a71d4c96549f1541` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:30.500389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992e2dbe380f4690a71d4c96549f1541)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:30.502697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:30.571027 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992e2dbe380f4690a71d4c96549f1541', 'request_id': 'req-bc81931b-a0ba-41f2-891a-a52c598092b4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.581483 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992e2dbe380f4690a71d4c96549f1541', 'request_id': 'req-bc81931b-a0ba-41f2-891a-a52c598092b4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.589245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992e2dbe380f4690a71d4c96549f1541', 'request_id': 'req-bc81931b-a0ba-41f2-891a-a52c598092b4'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.605505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] The token cache is being invalidate because project 992e2dbe380f4690a71d4c96549f1541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:30.605808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.606523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.608672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1297/2613] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:30 2022] DELETE /identity/v3/projects/992e2dbe380f4690a71d4c96549f1541 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:30.613049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:30.624570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefb731-7fa0-4242-ae78-58876d86b28b service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:30.703733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:30.705179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:30.705460 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:30.705733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] PATH_INFO: `/v3/users/c85ae235338b4633ac57542b9c23bca8` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:30.706962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85ae235338b4633ac57542b9c23bca8)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:30.708906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:30.758864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85ae235338b4633ac57542b9c23bca8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.765920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85ae235338b4633ac57542b9c23bca8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.778241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85ae235338b4633ac57542b9c23bca8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.778930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85ae235338b4633ac57542b9c23bca8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.788249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8d88436f-32d7-46af-9fbe-143eb9e8e731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85ae235338b4633ac57542b9c23bca8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:30.794983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1317/2614] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:30 2022] DELETE /identity/v3/users/c85ae235338b4633ac57542b9c23bca8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:26:31.090187 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.092600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:31.107231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81931b-a0ba-41f2-891a-a52c598092b4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.166900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.167847 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.168195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.168538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] PATH_INFO: `/v3/projects/860b6172dd9143228a19c0b0e579757e` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.169817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] RBAC: Authorizing `identity:delete_project(project_id=860b6172dd9143228a19c0b0e579757e)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.171882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.223772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860b6172dd9143228a19c0b0e579757e', 'request_id': 'req-4006da1d-57c7-4ad5-8b9b-34e9154b838a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:31.232275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860b6172dd9143228a19c0b0e579757e', 'request_id': 'req-4006da1d-57c7-4ad5-8b9b-34e9154b838a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:31.239500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860b6172dd9143228a19c0b0e579757e', 'request_id': 'req-4006da1d-57c7-4ad5-8b9b-34e9154b838a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:31.249743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] The token cache is being invalidate because project 860b6172dd9143228a19c0b0e579757e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:31.249936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:31.250585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4006da1d-57c7-4ad5-8b9b-34e9154b838a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:31.255893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1298/2615] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:31 2022] DELETE /identity/v3/projects/860b6172dd9143228a19c0b0e579757e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:31.257587 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.257907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.258190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.276668 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:31.277933 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:31.338499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1318/2616] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:31.346531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.346817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.347094 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.368527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:31.369761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:31.378325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1299/2617] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:31.382680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.392177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0845-61f5-49ca-b3c1-cc601ced384d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.396944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.397605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.397922 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.398200 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.398937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:26:31.399243 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.400853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.413039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1319/2618] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:26:31.417704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.427647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c45b6-37dc-4816-9034-92c586f4fae7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.432477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.433207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.433561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.434005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.435196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.436732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.464784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1300/2619] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:31.470849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.480771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e326b54-4255-44c5-b36b-26dadcda1e1a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.536707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.537561 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.537848 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.538148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.538828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.540755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.561118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1320/2620] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:31.565381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.575833 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769d556-ebf5-4b32-898d-af5a709cf5ff admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.581743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.582439 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.582952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.583228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.583942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.585528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.596799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1301/2621] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:26:31.601038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.611738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28a78-8803-4495-a7fd-5b2917ede699 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.616304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9278e-a8c7-4381-bd54-9ffa610e527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.616955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9278e-a8c7-4381-bd54-9ffa610e527d admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.617237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9278e-a8c7-4381-bd54-9ffa610e527d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.617510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9278e-a8c7-4381-bd54-9ffa610e527d admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.618252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9278e-a8c7-4381-bd54-9ffa610e527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.619849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9278e-a8c7-4381-bd54-9ffa610e527d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.629776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1321/2622] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:31.633751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.643689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052891-9a10-4e67-837d-d694a81a06f3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.648271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.649146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.649440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.649718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] PATH_INFO: `/v3/projects/99893d29a77d42499dd4e4ccb5c56109/users/377bdff988fe443ea8a9f59674a6f3c5/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.665237 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99893d29a77d42499dd4e4ccb5c56109, user_id=377bdff988fe443ea8a9f59674a6f3c5, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.667907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.683178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1302/2623] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:31 2022] PUT /identity/v3/projects/99893d29a77d42499dd4e4ccb5c56109/users/377bdff988fe443ea8a9f59674a6f3c5/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:31.693845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.694260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.694546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.721532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] MFA Rules not processed for user `377bdff988fe443ea8a9f59674a6f3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:31.722810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:31.788261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1322/2624] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:31.792749 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.853829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bab72-c274-46e3-a375-da50c041cf30 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.858469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.859114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.859399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.859737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.860432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.862352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.887120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1303/2625] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:26:31.891291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.903479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fea91-592c-4b8a-9e7e-ba83be004631 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:31.961055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:31.961719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:31.962028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:31.962301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:31.962984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:31.964883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:31.983972 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1323/2626] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:31 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:31.988626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:31.998780 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261071a-8285-484c-b80d-aea65e8b8432 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:32.003529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:32.004177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.004455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.004728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.005440 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:32.007053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:32.017920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1304/2627] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:32.021893 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:32.031581 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa30eae-6704-4182-a153-fc067c0b9fb8 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:32.037556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:32.038458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.038741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.039011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] PATH_INFO: `/v3/projects/a0f0977e7a734bbba561c1655be41370/users/884d944378dc4142bc4b5217c5198995/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.055342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f0977e7a734bbba561c1655be41370, user_id=884d944378dc4142bc4b5217c5198995, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:32.058055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:32.071510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1324/2628] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:32 2022] PUT /identity/v3/projects/a0f0977e7a734bbba561c1655be41370/users/884d944378dc4142bc4b5217c5198995/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:32.075414 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:32.086087 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984feed-cd7b-4405-a54c-6442d0b49b4b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:32.143840 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1c8-3ea2-4ce1-b785-e5740f430e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:32.144516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1c8-3ea2-4ce1-b785-e5740f430e05 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.144797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1c8-3ea2-4ce1-b785-e5740f430e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.145076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1c8-3ea2-4ce1-b785-e5740f430e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.145791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecf1c8-3ea2-4ce1-b785-e5740f430e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:32.147420 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecf1c8-3ea2-4ce1-b785-e5740f430e05 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:32.160358 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1305/2629] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:32.163602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:32.173571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba038504-2623-422a-9e04-f43fbec821b2 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:32.178120 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:32.178983 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.179259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.179527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] PATH_INFO: `/v3/projects/a0f0977e7a734bbba561c1655be41370/users/884d944378dc4142bc4b5217c5198995/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.181432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f0977e7a734bbba561c1655be41370, user_id=884d944378dc4142bc4b5217c5198995, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:32.184100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:32.193958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1325/2630] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:32 2022] PUT /identity/v3/projects/a0f0977e7a734bbba561c1655be41370/users/884d944378dc4142bc4b5217c5198995/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:32.205643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.205958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.206246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.235285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] MFA Rules not processed for user `884d944378dc4142bc4b5217c5198995`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:32.236479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:32.304533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1306/2631] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:32.315751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:32.317464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:32.371169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010786-eec8-46aa-b32e-d8d8cc9775f2 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:32.374715 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:32.375343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.375620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.376569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.385398 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:32.386840 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:32.396479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1326/2632] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:32.499388 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:32.509243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f418e82-bd0a-47ea-b67e-7eb58153bf62 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:32.512726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e849fd-cb7e-400a-ae34-ff25ec4913f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:32.513355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e849fd-cb7e-400a-ae34-ff25ec4913f2 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:32.513637 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e849fd-cb7e-400a-ae34-ff25ec4913f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:32.513946 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e849fd-cb7e-400a-ae34-ff25ec4913f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:32.569564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e849fd-cb7e-400a-ae34-ff25ec4913f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:32.571042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e849fd-cb7e-400a-ae34-ff25ec4913f2 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:32.580488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1307/2633] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:35.133609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:35.197352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d8f3b-dc9e-49e1-8bb1-06f358d2e1ce service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:35.202411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:35.203340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:35.203616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:35.203899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] PATH_INFO: `/v3/users/377bdff988fe443ea8a9f59674a6f3c5` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:35.205428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377bdff988fe443ea8a9f59674a6f3c5)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:35.207772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:35.266978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377bdff988fe443ea8a9f59674a6f3c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.274070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377bdff988fe443ea8a9f59674a6f3c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.287290 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377bdff988fe443ea8a9f59674a6f3c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.288097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377bdff988fe443ea8a9f59674a6f3c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.294785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377bdff988fe443ea8a9f59674a6f3c5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.301672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1327/2634] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:35 2022] DELETE /identity/v3/users/377bdff988fe443ea8a9f59674a6f3c5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:35.306323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:35.306850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:35.306973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:35.324633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:35.325848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:35.385255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1308/2635] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:35.395821 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:35.397287 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:35.453647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ff68d-fa37-46e3-8bc4-992405455e07 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:35.458773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:35.459477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:35.459760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:35.460033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:35.469022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:35.471039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:35.480414 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1328/2636] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:26:35.742796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:35.744379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:35.757960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93071cd1-75ba-4761-b23d-a4be355243f9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:35.763530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:35.764845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:35.765373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:35.765731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] PATH_INFO: `/v3/projects/99893d29a77d42499dd4e4ccb5c56109` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:35.768141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99893d29a77d42499dd4e4ccb5c56109)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:35.770807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:35.819071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99893d29a77d42499dd4e4ccb5c56109', 'request_id': 'req-7795aa47-77d8-4f59-a369-bafcf9129ba9'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.826171 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99893d29a77d42499dd4e4ccb5c56109', 'request_id': 'req-7795aa47-77d8-4f59-a369-bafcf9129ba9'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.832729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99893d29a77d42499dd4e4ccb5c56109', 'request_id': 'req-7795aa47-77d8-4f59-a369-bafcf9129ba9'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.842965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] The token cache is being invalidate because project 99893d29a77d42499dd4e4ccb5c56109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:35.843248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.843870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.845661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1309/2637] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:35 2022] DELETE /identity/v3/projects/99893d29a77d42499dd4e4ccb5c56109 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:35.849606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:35.861839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7d8e-5ad9-4201-a409-9156f0ab8491 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:35.919513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:35.920307 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:35.920584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:35.920853 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] PATH_INFO: `/v3/users/884d944378dc4142bc4b5217c5198995` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:35.922092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884d944378dc4142bc4b5217c5198995)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:35.924041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:35.970686 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884d944378dc4142bc4b5217c5198995'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.978180 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884d944378dc4142bc4b5217c5198995'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.989731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884d944378dc4142bc4b5217c5198995'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.990417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884d944378dc4142bc4b5217c5198995'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:35.996908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-e5c0545f-3a5f-4519-9368-4decb7480ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884d944378dc4142bc4b5217c5198995'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:36.003755 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1329/2638] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:35 2022] DELETE /identity/v3/users/884d944378dc4142bc4b5217c5198995 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:26:36.295257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.299457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:36.335032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795aa47-77d8-4f59-a369-bafcf9129ba9 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.417819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.418792 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.419074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.419348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] PATH_INFO: `/v3/projects/a0f0977e7a734bbba561c1655be41370` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.420678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f0977e7a734bbba561c1655be41370)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.423144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.482845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f0977e7a734bbba561c1655be41370', 'request_id': 'req-a9c4e7db-bc5b-444b-b979-87b19d6893f3'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:36.491582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f0977e7a734bbba561c1655be41370', 'request_id': 'req-a9c4e7db-bc5b-444b-b979-87b19d6893f3'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:36.499231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f0977e7a734bbba561c1655be41370', 'request_id': 'req-a9c4e7db-bc5b-444b-b979-87b19d6893f3'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:36.511356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] The token cache is being invalidate because project a0f0977e7a734bbba561c1655be41370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:36.518544 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:36.519392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a9c4e7db-bc5b-444b-b979-87b19d6893f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:36.521567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1310/2639] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:36 2022] DELETE /identity/v3/projects/a0f0977e7a734bbba561c1655be41370 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:36.527782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.528385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.528385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.548835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:36.550236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:36.619379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1330/2640] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:26:36.621179 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.621609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.622026 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.641186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:36.643426 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:36.654874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1311/2641] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:36.660331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.671951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4254faa-9214-4183-b054-ac7bc3e7ad85 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.678483 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.679758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.680186 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.680469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.681230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:26:36.681540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.683199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.696345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1331/2642] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:26:36.700682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.711414 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9afe46-9526-4f19-b8a6-69cad6656623 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.716410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.717994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.718487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.718767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.720260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.723507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.750262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1312/2643] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:36 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:36.755603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.765891 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f10d-9a38-4e7e-99ce-ed8d941f65b0 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.824590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.825379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.825967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.826313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.827131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.830093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.853128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1332/2644] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:36 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:26:36.857309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.868130 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367fb82-19ac-48d0-8d0e-045a334e8dcd admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.873759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.875424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.875424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.875424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.877177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.878909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.889728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1313/2645] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:36.894471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.905041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194e04c-2db8-4943-a34f-97e0c3aaa591 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.910944 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63386785-f2b4-4a82-9aa6-4434edd1d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.912045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63386785-f2b4-4a82-9aa6-4434edd1d845 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.912045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63386785-f2b4-4a82-9aa6-4434edd1d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.912261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63386785-f2b4-4a82-9aa6-4434edd1d845 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.912856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63386785-f2b4-4a82-9aa6-4434edd1d845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.914527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63386785-f2b4-4a82-9aa6-4434edd1d845 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.930040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1333/2646] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:36.931294 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:36.944770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b98d8-dcb6-48fe-bbf8-7288d68eeda4 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:36.949770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:36.950474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.950759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.951037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] PATH_INFO: `/v3/projects/942be3285a904520a8c47a1e5dc92f72/users/334a1c33cfd244c4a287e4d454f54c3b/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:36.967201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942be3285a904520a8c47a1e5dc92f72, user_id=334a1c33cfd244c4a287e4d454f54c3b, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:36.970417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:36.991149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1314/2647] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:36 2022] PUT /identity/v3/projects/942be3285a904520a8c47a1e5dc92f72/users/334a1c33cfd244c4a287e4d454f54c3b/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:36.995329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:36.995624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:36.995901 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:37.025607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] MFA Rules not processed for user `334a1c33cfd244c4a287e4d454f54c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:37.027297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:37.089448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1334/2648] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:26:37.100581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:37.103467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:37.169731 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b3dc2-5a2c-47cd-a04a-f7ccca3f1df8 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:37.173496 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beaa14-5b85-41be-86e0-455686aff7d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:37.174177 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beaa14-5b85-41be-86e0-455686aff7d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:37.174490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beaa14-5b85-41be-86e0-455686aff7d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:37.174762 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beaa14-5b85-41be-86e0-455686aff7d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:37.183336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beaa14-5b85-41be-86e0-455686aff7d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:37.184708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beaa14-5b85-41be-86e0-455686aff7d1 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:37.194952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1315/2649] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:37.215578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:37.282866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468ef28-2431-420e-bc17-6dd228d34535 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:37.289971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:37.291147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:37.291420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:37.291744 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] PATH_INFO: `/v3/users/334a1c33cfd244c4a287e4d454f54c3b` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:37.292977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=334a1c33cfd244c4a287e4d454f54c3b)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:37.294948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:37.343627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334a1c33cfd244c4a287e4d454f54c3b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.355331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334a1c33cfd244c4a287e4d454f54c3b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.368820 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334a1c33cfd244c4a287e4d454f54c3b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.369839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334a1c33cfd244c4a287e4d454f54c3b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.376838 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334a1c33cfd244c4a287e4d454f54c3b'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.382836 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1335/2650] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:37 2022] DELETE /identity/v3/users/334a1c33cfd244c4a287e4d454f54c3b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:37.387266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:37.387739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:37.388045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:37.406522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:37.409105 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:37.495615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1316/2651] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:37.506902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:37.508349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:37.569873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe041-e0d9-4205-abad-ba0d98b3df4f admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:37.573982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e3d76-68ed-46b2-98d4-7db51679393a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:37.574638 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e3d76-68ed-46b2-98d4-7db51679393a service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:37.574920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e3d76-68ed-46b2-98d4-7db51679393a service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:37.575196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e3d76-68ed-46b2-98d4-7db51679393a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:37.587056 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e3d76-68ed-46b2-98d4-7db51679393a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:37.588527 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e3d76-68ed-46b2-98d4-7db51679393a service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:37.599620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1336/2652] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:37.886070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:37.887592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:37.900589 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7873801-e3a2-4f24-9bcf-49c90b046133 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:37.905767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:37.906647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:37.906928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:37.907201 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] PATH_INFO: `/v3/projects/942be3285a904520a8c47a1e5dc92f72` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:37.909146 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942be3285a904520a8c47a1e5dc92f72)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:37.911152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:37.958961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942be3285a904520a8c47a1e5dc92f72', 'request_id': 'req-b87bd69d-f939-4741-84a9-d3265b145a33'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.965770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942be3285a904520a8c47a1e5dc92f72', 'request_id': 'req-b87bd69d-f939-4741-84a9-d3265b145a33'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.971795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942be3285a904520a8c47a1e5dc92f72', 'request_id': 'req-b87bd69d-f939-4741-84a9-d3265b145a33'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.981417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] The token cache is being invalidate because project 942be3285a904520a8c47a1e5dc92f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:37.981699 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.982353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b87bd69d-f939-4741-84a9-d3265b145a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:37.983871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1317/2653] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:37 2022] DELETE /identity/v3/projects/942be3285a904520a8c47a1e5dc92f72 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:26:37.989751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:37.990111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:37.990409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.008599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:38.009778 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:38.066059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1337/2654] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:38.074783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.075075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.075359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.093576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:38.094816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:38.102553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1318/2655] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:38.106555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.116229 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84006246-eed5-4e9e-9988-8c3103aae286 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.120631 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.121268 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.121546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.121815 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.122559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:26:38.122859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.124444 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.136375 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1338/2656] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:26:38.140505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.149696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef84e8-26ad-4bcf-9b5a-49fdc2c0377f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.154364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.155265 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.155549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.155829 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.156516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.158617 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.183397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1319/2657] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:26:38 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:26:38.187832 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.198522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4237a9-9613-4b56-a444-0ecdb062d885 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.255727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.256386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.256664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.256935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.257616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.259554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.278934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1339/2658] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:26:38 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:26:38.283523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.293778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d325-c2f0-4361-b178-0961e1f23e6b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.299079 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.299735 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.300018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.300293 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.301011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.302888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.313702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1320/2659] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:26:38.317896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.327543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02034-2868-4bd0-81bf-17287a6baf31 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.332793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92f722-5abc-4042-8eff-cf0b098123f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.333433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92f722-5abc-4042-8eff-cf0b098123f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.333710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92f722-5abc-4042-8eff-cf0b098123f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.334026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92f722-5abc-4042-8eff-cf0b098123f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.334733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92f722-5abc-4042-8eff-cf0b098123f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.336320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92f722-5abc-4042-8eff-cf0b098123f8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.345873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1340/2660] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:26:38.349962 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.359418 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094994-0d5a-4d07-8df4-25f78daa9674 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.364129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.364992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.365271 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.365545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] PATH_INFO: `/v3/projects/adbc569885f64749b5bbe7f3a2838969/users/8f4b49e3b23d46368233d60215504105/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.380853 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbc569885f64749b5bbe7f3a2838969, user_id=8f4b49e3b23d46368233d60215504105, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.383542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.404030 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1321/2661] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:26:38 2022] PUT /identity/v3/projects/adbc569885f64749b5bbe7f3a2838969/users/8f4b49e3b23d46368233d60215504105/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:38.414926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.415218 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.415632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.441542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] MFA Rules not processed for user `8f4b49e3b23d46368233d60215504105`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:38.442786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:38.505596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1341/2662] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:38.516545 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.518235 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:38.519391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:38.520727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:38.575557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252f79f-95cb-44f7-b830-2e3203fb09b1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.579911 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.580574 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.580732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20811be7-65d5-4507-b54a-747b84d4c488 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:38.581186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.581186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.584456 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:38.585091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:38.585367 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:38.585639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:38.587449 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:38.589296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.590754 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.599319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1322/2663] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:38.648968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:38.650454 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:38.660947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1342/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:39.420443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:39.421884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:39.435680 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0178-8209-4ab5-aad3-7ecd1cea3bc3 service cinder] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:39.440598 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:39.441469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:39.441751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:39.442057 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] PATH_INFO: `/v3/users/6d080fb7bd6049dea53fe1912d46b11b` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:39.443236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d080fb7bd6049dea53fe1912d46b11b)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:39.445144 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:39.489065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d080fb7bd6049dea53fe1912d46b11b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.495578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d080fb7bd6049dea53fe1912d46b11b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.507467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d080fb7bd6049dea53fe1912d46b11b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.508099 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d080fb7bd6049dea53fe1912d46b11b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.508697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-3bc149ff-a496-4183-a511-059fc39d0df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d080fb7bd6049dea53fe1912d46b11b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.520924 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1323/2665] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:39 2022] DELETE /identity/v3/users/6d080fb7bd6049dea53fe1912d46b11b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:39.691974 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:39.702277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471dfa0-f9b5-40a2-8253-f574c930df46 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:39.760842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:39.761710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:39.762034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:39.762310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] PATH_INFO: `/v3/projects/3d53fd1057c44dffb358b098d5f190fa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:39.763492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d53fd1057c44dffb358b098d5f190fa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:39.765442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:39.809943 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d53fd1057c44dffb358b098d5f190fa', 'request_id': 'req-34c8a4d7-8cec-4fc2-b774-5c425e30e097'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.816818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d53fd1057c44dffb358b098d5f190fa', 'request_id': 'req-34c8a4d7-8cec-4fc2-b774-5c425e30e097'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.822788 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d53fd1057c44dffb358b098d5f190fa', 'request_id': 'req-34c8a4d7-8cec-4fc2-b774-5c425e30e097'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.832555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] The token cache is being invalidate because project 3d53fd1057c44dffb358b098d5f190fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:39.832845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.833476 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-34c8a4d7-8cec-4fc2-b774-5c425e30e097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:39.835022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1343/2666] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:39 2022] DELETE /identity/v3/projects/3d53fd1057c44dffb358b098d5f190fa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:39.947077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:39.947359 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:39.947647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:39.966307 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] MFA Rules not processed for user `8f4b49e3b23d46368233d60215504105`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:39.967519 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:40.026338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1324/2667] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:52.466348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951b00-6fc7-4802-b97c-f2eac56bb587 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:52.466799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951b00-6fc7-4802-b97c-f2eac56bb587 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:52.466897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951b00-6fc7-4802-b97c-f2eac56bb587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:52.484570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-fd951b00-6fc7-4802-b97c-f2eac56bb587 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:52.485761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-fd951b00-6fc7-4802-b97c-f2eac56bb587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:52.544670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1344/2668] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:52.556632 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:52.558102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:52.624564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a405de5-7498-4336-8370-82bda30114c6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:52.629956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:52.630594 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:52.630878 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:52.631152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:52.638976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:52.640556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:52.648978 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1325/2669] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:53.135995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb3187-5558-4d23-ac62-731984142202 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:53.136280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb3187-5558-4d23-ac62-731984142202 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:53.136554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb3187-5558-4d23-ac62-731984142202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:53.155191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4dfb3187-5558-4d23-ac62-731984142202 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:53.156376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4dfb3187-5558-4d23-ac62-731984142202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:53.163873 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1345/2670] 10.222.0.30 () {58 vars in 967 bytes} [Tue Mar 8 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:53.176532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:53.186728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1afe9-443c-4657-97bc-ee40f27db0f1 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:53.191973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:53.192596 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:53.192959 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:53.193148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:53.200991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:53.202624 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:53.211167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1326/2671] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:53.397469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ef65-669e-48e6-b407-e853ab382a20 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:53.397758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ef65-669e-48e6-b407-e853ab382a20 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:53.398065 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637ef65-669e-48e6-b407-e853ab382a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:53.428308 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4637ef65-669e-48e6-b407-e853ab382a20 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:53.429553 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4637ef65-669e-48e6-b407-e853ab382a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:53.436664 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1346/2672] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:53.448957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:53.460448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d25c-43a0-4b6c-bdb2-96f185861773 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:53.470036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:53.470682 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:53.471505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:53.471779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:53.482520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:53.484173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:53.492778 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1327/2673] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:53.806182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:53.806654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:53.806761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:53.824107 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:53.825282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:53.833029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1347/2674] 10.222.0.30 () {58 vars in 967 bytes} [Tue Mar 8 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:53.844802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:53.855486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e35a-46a1-4eaf-872b-a17dd508db51 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:53.860364 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d706f5f-f6b7-4f5b-b66c-4fa09297b2dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:53.860989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d706f5f-f6b7-4f5b-b66c-4fa09297b2dc service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:53.861267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d706f5f-f6b7-4f5b-b66c-4fa09297b2dc service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:53.862335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d706f5f-f6b7-4f5b-b66c-4fa09297b2dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:53.870173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d706f5f-f6b7-4f5b-b66c-4fa09297b2dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:53.871775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d706f5f-f6b7-4f5b-b66c-4fa09297b2dc service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:53.880379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1328/2675] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:55.891867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:55.893879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:55.957678 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecd970-5a56-4351-886b-5b0015660cfc None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:55.962143 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:55.963006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:55.963282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:55.963551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] PATH_INFO: `/v3/users/8f4b49e3b23d46368233d60215504105` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:55.964740 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4b49e3b23d46368233d60215504105)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:55.966691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:56.009817 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4b49e3b23d46368233d60215504105'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.016881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4b49e3b23d46368233d60215504105'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.029310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4b49e3b23d46368233d60215504105'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.029974 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4b49e3b23d46368233d60215504105'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.036465 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4b49e3b23d46368233d60215504105'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.042205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1348/2676] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:26:55 2022] DELETE /identity/v3/users/8f4b49e3b23d46368233d60215504105 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:26:56.046686 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:56.047152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:56.047274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:56.065405 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:26:56.066712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:56.123199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1329/2677] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:26:56.133510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:56.134935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:56.190379 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d252fed-3f57-4123-a928-b3c1fae23610 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:56.193987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786519-b088-42a5-a284-b0ce1050e042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:56.194622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786519-b088-42a5-a284-b0ce1050e042 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:56.194902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786519-b088-42a5-a284-b0ce1050e042 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:56.195174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786519-b088-42a5-a284-b0ce1050e042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:56.203844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786519-b088-42a5-a284-b0ce1050e042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:56.205461 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786519-b088-42a5-a284-b0ce1050e042 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:56.214584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1349/2678] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:26:56.377999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:26:56.379470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:26:56.392397 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9af2c0-c142-41f8-94db-566017395d6f None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:26:56.399930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:26:56.400808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:26:56.401165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:26:56.401416 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] PATH_INFO: `/v3/projects/adbc569885f64749b5bbe7f3a2838969` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:26:56.402710 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbc569885f64749b5bbe7f3a2838969)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:26:56.404837 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:26:56.450803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbc569885f64749b5bbe7f3a2838969', 'request_id': 'req-fb71a374-79cd-45e7-abbf-fce959ffeca3'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.458274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbc569885f64749b5bbe7f3a2838969', 'request_id': 'req-fb71a374-79cd-45e7-abbf-fce959ffeca3'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.464508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbc569885f64749b5bbe7f3a2838969', 'request_id': 'req-fb71a374-79cd-45e7-abbf-fce959ffeca3'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.475327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] The token cache is being invalidate because project adbc569885f64749b5bbe7f3a2838969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:26:56.475615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.476252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-fb71a374-79cd-45e7-abbf-fce959ffeca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:26:56.477806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1330/2679] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:26:56 2022] DELETE /identity/v3/projects/adbc569885f64749b5bbe7f3a2838969 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:27:23.069361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:23.069846 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:23.070005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:23.087162 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] MFA Rules not processed for user `282b16dbcb1648c39afa0f7ed2d5dbda`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:27:23.088342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:23.138737 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1350/2680] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:27:25.852449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:25.853050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:25.853050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:25.873202 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:27:25.874450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:25.935732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1331/2681] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:27:25.962615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:25.964032 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:26.042926 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48c20-6e9b-4393-9110-c89155f452b8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:26.048163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:26.049507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:26.049789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:26.050094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:26.059361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:26.060645 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:26.075210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1351/2682] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:27:31.665691 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:31.670346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:31.772170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38398db9-84f7-4f05-871f-001b5c8eab54 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:31.777151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:31.778181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:31.778717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:31.778999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:31.781084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:31.794153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:31.795618 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:31.806839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1332/2683] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:27:39.557343 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:39.566506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979b37-6378-4d39-8669-d487fd93a3b4 service swift] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:39.570167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:39.570793 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:39.571073 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:39.571346 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:39.573110 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:39.583019 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:39.584438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:39.592237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1352/2684] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:27:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:27:40.697009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:40.698425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:40.775565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03cb4d-7049-4710-9c8c-a9e964260742 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:40.779775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:40.780473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:40.780752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:40.781034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:40.782817 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:40.865905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:40.867342 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:40.879055 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1333/2685] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:27:40.942879 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:40.951401 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d420a7-08af-417c-b187-b50f2acf61d6 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:40.954880 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:40.955691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:40.955977 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:40.956259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:40.958029 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:40.967161 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:40.968580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ad846-d371-4dd3-9163-1a6e8fb25982 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:40.976291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1353/2686] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:27:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:27:41.063060 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:41.072233 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c83db1-307a-46fc-90ed-11d5e67de7c5 service glance] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:41.075803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:41.076431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:41.076709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:41.076981 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:41.078698 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:41.091874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:41.093279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:41.105191 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1334/2687] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:27:42.649528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0a37-a93d-425c-9028-c6e8e30681db None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:42.650003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0a37-a93d-425c-9028-c6e8e30681db None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:42.650115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0a37-a93d-425c-9028-c6e8e30681db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:42.667790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-993e0a37-a93d-425c-9028-c6e8e30681db None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:27:42.668973 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-993e0a37-a93d-425c-9028-c6e8e30681db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:42.676666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1354/2688] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Mar 8 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:27:42.688231 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:42.699673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73b722-f005-4253-8b53-9861bce0e116 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:42.705128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:42.705770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:42.706095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:42.706377 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:42.714430 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:42.716003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:42.724579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1335/2689] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:27:57.049201 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2a49c-f489-4fa8-b8c4-13040b7d72f9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:57.049718 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2a49c-f489-4fa8-b8c4-13040b7d72f9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:57.049833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2a49c-f489-4fa8-b8c4-13040b7d72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:57.067259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-96f2a49c-f489-4fa8-b8c4-13040b7d72f9 None None] MFA Rules not processed for user `35aafe4494a046cca9096751b630db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:27:57.068458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-96f2a49c-f489-4fa8-b8c4-13040b7d72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:27:57.075603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1355/2690] 10.222.0.30 () {58 vars in 967 bytes} [Tue Mar 8 15:27:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:27:57.087794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:27:57.099582 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17816ce-4593-4bef-92cb-801dde2ec732 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:27:57.104663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b56d7d7db04439a40f4a02b9ad8135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:27:57.105296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:27:57.105576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:27:57.105881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:27:57.116113 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:27:57.117723 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:27:57.125556 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1336/2691] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Mar 8 15:27:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:22.761934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:22.762515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:22.762515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:22.780872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] MFA Rules not processed for user `282b16dbcb1648c39afa0f7ed2d5dbda`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:22.782667 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:22.789490 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1356/2692] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:24.504786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:24.513996 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03dcf4-0d50-4438-a691-e02bfd54d1b9 service swift] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:24.518125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:24.518845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:24.519189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:24.519528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:24.521350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:24.535132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:24.536643 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:24.548752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1337/2693] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:28:25.693978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:25.696281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:25.709442 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60becd71-2bf0-4499-94b6-22fad1840847 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:25.713691 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:25.714422 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:25.714701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:25.714968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:25.716764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:25.731603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:25.733085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:25.746331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1357/2694] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:28:38.927922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:38.936290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f36925-1002-4a8d-8d5c-3d493f920a7f service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:38.940647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:38.941333 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:38.941693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:38.942002 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:38.943772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:39.005209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:39.006678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:39.016587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1338/2695] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:28:42.266446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:42.268209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:42.283178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34878ae6-7be6-4947-bec6-c5995fb9efa6 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:42.287896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:42.288768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.289049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.289348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] PATH_INFO: `/v3/users/1775260bd3f947ea85d14b3a1aa80b38` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.290563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1775260bd3f947ea85d14b3a1aa80b38)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:42.292477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:42.336942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1775260bd3f947ea85d14b3a1aa80b38'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.344759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1775260bd3f947ea85d14b3a1aa80b38'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.356136 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1775260bd3f947ea85d14b3a1aa80b38'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.356785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1775260bd3f947ea85d14b3a1aa80b38'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.363839 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-765f5d9e-7243-458f-9205-5f17332bd281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1775260bd3f947ea85d14b3a1aa80b38'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.369634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1358/2696] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:28:42 2022] DELETE /identity/v3/users/1775260bd3f947ea85d14b3a1aa80b38 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:42.547199 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:42.558474 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808b488-d4be-4d1f-983b-3491d42355cd service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:42.617135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:42.618063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.618353 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.618633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] PATH_INFO: `/v3/projects/0cdd8e70c5dc4d1a8f531591dbd9216f` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.619926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdd8e70c5dc4d1a8f531591dbd9216f)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:42.622790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:42.667718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'request_id': 'req-6859d47c-2254-4ae6-8148-c0f9b55ad072'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.675551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'request_id': 'req-6859d47c-2254-4ae6-8148-c0f9b55ad072'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.681547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'request_id': 'req-6859d47c-2254-4ae6-8148-c0f9b55ad072'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.691634 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] The token cache is being invalidate because project 0cdd8e70c5dc4d1a8f531591dbd9216f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:28:42.691919 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.692536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-6859d47c-2254-4ae6-8148-c0f9b55ad072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:42.694100 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1339/2697] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:28:42 2022] DELETE /identity/v3/projects/0cdd8e70c5dc4d1a8f531591dbd9216f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:42.699003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.699283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.699558 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.716948 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:42.718163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:42.776126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1359/2698] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:42.784689 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.784975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.785255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.803921 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:42.805106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:42.813209 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1340/2699] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:42.817286 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:42.826622 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513057e7-2285-4be2-b19b-5587cd36c2b1 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:42.831431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:42.832074 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.832351 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.832619 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.833317 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:28:42.833616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:42.835242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:42.847474 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1360/2700] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:28:42.851633 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:42.861178 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb2233-80c5-4655-97fd-3f082b3c7e07 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:42.865812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:42.866472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.866752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.867029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.867707 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:42.869575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:42.898194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1341/2701] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:28:42 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:28:42.899302 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:42.910437 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50b0cc-9062-4af8-8ea5-07fa2f8194a0 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:42.965281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:42.965985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:42.966263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:42.966533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:42.967199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:42.969617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:42.989031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1361/2702] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:28:42 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:28:42.993170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:43.003344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849d656-60fb-4763-ad72-b3c6d103c793 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:43.008131 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:43.008860 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:43.009136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:43.009406 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:43.010181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:43.011765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:43.022438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1342/2703] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:43.026283 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:43.036877 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7e87-959a-410f-b664-72b308c5da09 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:43.041516 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9f59b-b64c-4bee-98c4-8749531f0f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:43.042216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9f59b-b64c-4bee-98c4-8749531f0f4d admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:43.042533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9f59b-b64c-4bee-98c4-8749531f0f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:43.042828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9f59b-b64c-4bee-98c4-8749531f0f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:43.043633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9f59b-b64c-4bee-98c4-8749531f0f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:43.045236 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9f59b-b64c-4bee-98c4-8749531f0f4d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:43.055062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1362/2704] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:43.059086 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:43.069172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976718-fbe7-4ace-a63e-28569c2a7eec admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:43.073765 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:43.074726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:43.075007 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:43.075285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] PATH_INFO: `/v3/projects/ef99158b803e4485aa7cf23941f6794a/users/2e7f1ae629e84d189ee56167fc7db7b2/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:43.090098 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef99158b803e4485aa7cf23941f6794a, user_id=2e7f1ae629e84d189ee56167fc7db7b2, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:43.092718 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:43.105789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1343/2705] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:28:43 2022] PUT /identity/v3/projects/ef99158b803e4485aa7cf23941f6794a/users/2e7f1ae629e84d189ee56167fc7db7b2/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:43.116732 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:43.117053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:43.117357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:43.143874 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] MFA Rules not processed for user `2e7f1ae629e84d189ee56167fc7db7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:43.145077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:43.205630 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1363/2706] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:28:43.216534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:43.218195 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:43.290966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142009-184e-4c5d-86a7-ecb51035f8bd admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:43.296328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685880c7-4cad-4d5a-a325-cf83eaae9a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:43.296965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685880c7-4cad-4d5a-a325-cf83eaae9a1e service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:43.297250 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685880c7-4cad-4d5a-a325-cf83eaae9a1e service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:43.297547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685880c7-4cad-4d5a-a325-cf83eaae9a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:43.305257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685880c7-4cad-4d5a-a325-cf83eaae9a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:43.306926 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685880c7-4cad-4d5a-a325-cf83eaae9a1e service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:43.315464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1344/2707] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:28:50.525364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:50.585294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238a751-be5c-4118-b537-db74fc3662f7 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:50.590445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:50.591329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:50.591662 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:50.591937 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] PATH_INFO: `/v3/users/2e7f1ae629e84d189ee56167fc7db7b2` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:50.593306 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7f1ae629e84d189ee56167fc7db7b2)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:50.595275 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:50.639550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7f1ae629e84d189ee56167fc7db7b2'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:50.645786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7f1ae629e84d189ee56167fc7db7b2'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:50.657310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7f1ae629e84d189ee56167fc7db7b2'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:50.657968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7f1ae629e84d189ee56167fc7db7b2'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:50.664968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7f1ae629e84d189ee56167fc7db7b2'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:50.670758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1364/2708] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:28:50 2022] DELETE /identity/v3/users/2e7f1ae629e84d189ee56167fc7db7b2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:50.675827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:50.676368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:50.676368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:50.694578 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:50.695784 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:50.752711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1345/2709] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:50.763137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:50.764531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:50.820140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b1d01-fd44-4e6e-a6d1-038863000dd5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:50.823966 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10844fab-b056-4f4b-b85b-798df3078cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:50.824635 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844fab-b056-4f4b-b85b-798df3078cde service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:50.824916 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844fab-b056-4f4b-b85b-798df3078cde service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:50.825188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844fab-b056-4f4b-b85b-798df3078cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:50.834114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844fab-b056-4f4b-b85b-798df3078cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:50.835543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844fab-b056-4f4b-b85b-798df3078cde service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:50.844627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1365/2710] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:28:51.111266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.113286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:51.126636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d01bd-0ba6-47eb-acee-e7e6def170f3 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.131484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.132438 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.132726 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.133005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] PATH_INFO: `/v3/projects/ef99158b803e4485aa7cf23941f6794a` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.134266 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef99158b803e4485aa7cf23941f6794a)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.136261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.185248 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef99158b803e4485aa7cf23941f6794a', 'request_id': 'req-370e31b4-8c12-41b8-9fb7-1d8df964f46b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:51.192728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef99158b803e4485aa7cf23941f6794a', 'request_id': 'req-370e31b4-8c12-41b8-9fb7-1d8df964f46b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:51.199636 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef99158b803e4485aa7cf23941f6794a', 'request_id': 'req-370e31b4-8c12-41b8-9fb7-1d8df964f46b'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:51.210897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] The token cache is being invalidate because project ef99158b803e4485aa7cf23941f6794a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:28:51.211188 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:51.211838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-370e31b4-8c12-41b8-9fb7-1d8df964f46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:51.213352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1346/2711] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:28:51 2022] DELETE /identity/v3/projects/ef99158b803e4485aa7cf23941f6794a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:51.218251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.218535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.218811 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.236819 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:51.238374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:51.295735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1366/2712] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:51.304081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.304370 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.304650 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.324455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:51.325652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:51.334309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1347/2713] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:51.338416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.348994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762235ba-f14f-48f7-9033-ad4e881dd060 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.353491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.354176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.354458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.354734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.355441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:28:51.355747 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.357341 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.368958 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1367/2714] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:28:51.373061 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.382037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cda2ae-79b2-4b03-bf54-c16af9524db2 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.386649 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.387289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.387569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.387846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.388520 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.390465 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.415972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1348/2715] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:28:51 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:28:51.419994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.430388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c34e-fcff-4c37-9dfa-61c5bbec4e53 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.485241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.485954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.486252 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.486528 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.487211 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.489529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.509237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1368/2716] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:28:51 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:28:51.513327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.523815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd378657-15d8-4bed-b3ac-3a35ce41ce5a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.528661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.529309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.529593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.529894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.530611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.532194 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.542628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1349/2717] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:51.546254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.555693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73c6d-3b08-4389-9e9e-fab295fd6708 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.560216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f74ac-64f1-4c9f-8272-9364063088fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.560859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f74ac-64f1-4c9f-8272-9364063088fd admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.561141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f74ac-64f1-4c9f-8272-9364063088fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.561416 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f74ac-64f1-4c9f-8272-9364063088fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.562179 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f74ac-64f1-4c9f-8272-9364063088fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.563780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f74ac-64f1-4c9f-8272-9364063088fd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.573785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1369/2718] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:51.577775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.587938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fc174-53df-46c4-828e-6e959be11f25 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.592557 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.593425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.593709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.594018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] PATH_INFO: `/v3/projects/0e7f9b26a1ed450db5db1212b51f5114/users/b7005066318a4945934545ba8656ac7e/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.608506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7f9b26a1ed450db5db1212b51f5114, user_id=b7005066318a4945934545ba8656ac7e, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.611181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.623280 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1350/2719] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:28:51 2022] PUT /identity/v3/projects/0e7f9b26a1ed450db5db1212b51f5114/users/b7005066318a4945934545ba8656ac7e/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:51.634342 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.634633 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.634912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.666340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] MFA Rules not processed for user `b7005066318a4945934545ba8656ac7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:51.667546 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:51.728586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1370/2720] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:51.739368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:51.740983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:51.818877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70781c8-5d9f-4462-98b3-7ae773453083 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:51.824448 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b1b6-6498-4075-a50d-2814f00e8a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54185e0e2c5549f3b397a8009ae27713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:51.825089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b1b6-6498-4075-a50d-2814f00e8a9f service nova] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:51.825372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b1b6-6498-4075-a50d-2814f00e8a9f service nova] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:51.825647 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b1b6-6498-4075-a50d-2814f00e8a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:51.833927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b1b6-6498-4075-a50d-2814f00e8a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:51.835525 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b1b6-6498-4075-a50d-2814f00e8a9f service nova] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:51.844183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1351/2721] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:28:54.479824 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:54.539713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a26b1-b90f-445a-b62d-063d82e367a4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:54.544226 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:54.545100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:54.545386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:54.545679 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] PATH_INFO: `/v3/users/b7005066318a4945934545ba8656ac7e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:54.546878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7005066318a4945934545ba8656ac7e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:54.548889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:54.596062 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7005066318a4945934545ba8656ac7e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:54.603987 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7005066318a4945934545ba8656ac7e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:54.615174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7005066318a4945934545ba8656ac7e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:54.615792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7005066318a4945934545ba8656ac7e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:54.622462 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7005066318a4945934545ba8656ac7e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:54.628203 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1371/2722] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:28:54 2022] DELETE /identity/v3/users/b7005066318a4945934545ba8656ac7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:54.633170 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:54.633674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:54.633798 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:54.651325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:54.652776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:54.708818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1352/2723] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:54.718920 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:54.720316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:54.774892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c519c-dbed-42ff-9dd5-41cdb800733c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:54.778746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5936bd1-0fa0-4072-8600-89c3f31b4232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:54.779377 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936bd1-0fa0-4072-8600-89c3f31b4232 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:54.779651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936bd1-0fa0-4072-8600-89c3f31b4232 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:54.779919 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5936bd1-0fa0-4072-8600-89c3f31b4232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:54.788517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936bd1-0fa0-4072-8600-89c3f31b4232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:54.790537 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5936bd1-0fa0-4072-8600-89c3f31b4232 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:54.799470 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1372/2724] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:28:55.062975 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.064402 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:55.076140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a9b1-7fd5-4baf-b42f-20cc32ba2bc1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.080799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.081696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.082018 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.082298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] PATH_INFO: `/v3/projects/0e7f9b26a1ed450db5db1212b51f5114` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.083490 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7f9b26a1ed450db5db1212b51f5114)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.085409 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.130899 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7f9b26a1ed450db5db1212b51f5114', 'request_id': 'req-a3f11db7-f7a7-4ec0-b0de-47a862785f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:55.138256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7f9b26a1ed450db5db1212b51f5114', 'request_id': 'req-a3f11db7-f7a7-4ec0-b0de-47a862785f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:55.144509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7f9b26a1ed450db5db1212b51f5114', 'request_id': 'req-a3f11db7-f7a7-4ec0-b0de-47a862785f89'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:55.155212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] The token cache is being invalidate because project 0e7f9b26a1ed450db5db1212b51f5114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:28:55.155494 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:55.156118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-a3f11db7-f7a7-4ec0-b0de-47a862785f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:28:55.157614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1353/2725] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:28:55 2022] DELETE /identity/v3/projects/0e7f9b26a1ed450db5db1212b51f5114 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:55.162627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.162918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.163188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.182548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:55.183757 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:55.242927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1373/2726] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:28:55.252095 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.252385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.252663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.271615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:55.272807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:55.281592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1354/2727] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:55.285752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.295463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9d587-ed53-4931-b144-2656ea50bb08 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.300040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.300703 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.300989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.301264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.302007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:28:55.302315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.303998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.315447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1374/2728] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:28:55.319513 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.329065 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225f6b-7a9a-405b-a057-0cb665a7b9c6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.333661 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.334340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.334621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.334897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.335572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.338141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.363555 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1355/2729] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:28:55.367780 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.377329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcbe1c-d915-4586-af59-60487ea70885 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.431693 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.432349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.432627 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.432896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.433578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.435696 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.455230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1375/2730] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:28:55.459357 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.470090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d001-2937-4da5-8cf7-6f2977893d30 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.474814 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.475461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.475745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.476021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.476774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.478346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.488312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1356/2731] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:55.492182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.502061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467617a-ab9a-4066-85ce-6c3d90fbcb63 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.506589 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940e99d-2406-41ba-b0a2-d2d7af80de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.507240 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940e99d-2406-41ba-b0a2-d2d7af80de69 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.508068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940e99d-2406-41ba-b0a2-d2d7af80de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.508894 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940e99d-2406-41ba-b0a2-d2d7af80de69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.509813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940e99d-2406-41ba-b0a2-d2d7af80de69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.511548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940e99d-2406-41ba-b0a2-d2d7af80de69 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.522464 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1376/2732] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:28:55.527455 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.537064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c1069-84da-4d25-b4a3-50ddc04cc450 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.541627 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.542526 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.542806 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.543080 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] PATH_INFO: `/v3/projects/bd00fff4e7534c48ae73d024d110c1d7/users/57c2e6d1c3554b32b606ef93d6b2d50e/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.557329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd00fff4e7534c48ae73d024d110c1d7, user_id=57c2e6d1c3554b32b606ef93d6b2d50e, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.559965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.572967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1357/2733] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:28:55 2022] PUT /identity/v3/projects/bd00fff4e7534c48ae73d024d110c1d7/users/57c2e6d1c3554b32b606ef93d6b2d50e/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:28:55.583025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.583319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.583599 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.609293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] MFA Rules not processed for user `57c2e6d1c3554b32b606ef93d6b2d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:55.610532 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:55.672781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1377/2734] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:28:55.677732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.744733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db08df6-ba13-4dcf-8ffe-82843e9beaca admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.749360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.750041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.750325 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.750599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.751284 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.753229 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.780165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1358/2735] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:28:55.784363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.794751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c4f3-fa3f-4e1a-ab1e-e41413aea45e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.847600 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.848254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.848531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.848801 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.849484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.851657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.871521 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1378/2736] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:28:55 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:28:55.875462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.886245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e120888-1255-44ca-8752-5a7dcf599101 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.890743 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.891392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.891673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.891948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.892654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.894276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.904587 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1359/2737] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:55.908596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.918918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7280efb-65cd-47b8-8bfc-0dffe2215e4e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:55.923443 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:55.924303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:55.924576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:55.924842 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] PATH_INFO: `/v3/projects/98b6d66bdcda44b6a121893c063b14b5/users/f1d309a5ea4b495fa9f4aab915df64f6/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:55.939623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b6d66bdcda44b6a121893c063b14b5, user_id=f1d309a5ea4b495fa9f4aab915df64f6, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:55.942329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:55.955557 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1379/2738] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:28:55 2022] PUT /identity/v3/projects/98b6d66bdcda44b6a121893c063b14b5/users/f1d309a5ea4b495fa9f4aab915df64f6/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:55.959639 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:55.969812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97894ca4-35bb-4271-bd36-ededcf9a57ea admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:56.027666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac5ee-a363-4845-9118-d224b670ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:56.028260 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac5ee-a363-4845-9118-d224b670ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:56.028543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac5ee-a363-4845-9118-d224b670ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:56.028818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac5ee-a363-4845-9118-d224b670ef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:56.029530 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac5ee-a363-4845-9118-d224b670ef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:56.031153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac5ee-a363-4845-9118-d224b670ef02 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:56.041153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1360/2739] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:28:56.045623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:56.056245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02b46-8e1c-4aae-a52f-aa26a4f17436 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:56.060807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:56.061672 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:56.061981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:56.062251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] PATH_INFO: `/v3/projects/98b6d66bdcda44b6a121893c063b14b5/users/f1d309a5ea4b495fa9f4aab915df64f6/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:56.064153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b6d66bdcda44b6a121893c063b14b5, user_id=f1d309a5ea4b495fa9f4aab915df64f6, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:56.066806 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:56.076659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1380/2740] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:28:56 2022] PUT /identity/v3/projects/98b6d66bdcda44b6a121893c063b14b5/users/f1d309a5ea4b495fa9f4aab915df64f6/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:28:56.086497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:56.086791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:56.087075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:56.112761 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] MFA Rules not processed for user `f1d309a5ea4b495fa9f4aab915df64f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:28:56.113993 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:56.177979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1361/2741] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:28:56.189810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:28:56.191567 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:28:56.256392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f409c6-9ca4-47db-99dd-802ded5abf38 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:28:56.260378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:28:56.261005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:28:56.261281 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:28:56.261550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:28:56.314432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:28:56.315798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:28:56.324340 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1381/2742] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:01.922166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:01.923543 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:01.935612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53643d0c-e05d-4f0c-8ee9-27b939d3e44b None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:01.939365 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f780c3-7364-42aa-84ef-f48b42605a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:01.940035 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f780c3-7364-42aa-84ef-f48b42605a1e service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:01.940301 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f780c3-7364-42aa-84ef-f48b42605a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:01.940593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f780c3-7364-42aa-84ef-f48b42605a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:01.950372 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f780c3-7364-42aa-84ef-f48b42605a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:01.951834 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f780c3-7364-42aa-84ef-f48b42605a1e service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:01.961675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1362/2743] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:25.592660 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:25.651526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d919-2af4-461a-a1cd-829700c7e788 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:25.656750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:25.657613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:25.657913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:25.658185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] PATH_INFO: `/v3/users/57c2e6d1c3554b32b606ef93d6b2d50e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:25.659347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c2e6d1c3554b32b606ef93d6b2d50e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:25.661256 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:25.708223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c2e6d1c3554b32b606ef93d6b2d50e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:25.715445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c2e6d1c3554b32b606ef93d6b2d50e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:25.726605 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c2e6d1c3554b32b606ef93d6b2d50e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:25.727209 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c2e6d1c3554b32b606ef93d6b2d50e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:25.734234 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c2e6d1c3554b32b606ef93d6b2d50e'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:25.740295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1382/2744] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:25 2022] DELETE /identity/v3/users/57c2e6d1c3554b32b606ef93d6b2d50e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:25.744823 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:25.745323 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:25.745441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:25.762607 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:25.763796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:25.821813 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1363/2745] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:25.831869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:25.833280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:25.888935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc7d31-214f-4c1f-b590-f446e60e8196 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:25.892526 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:25.893158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:25.893435 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:25.893704 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:25.903453 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:25.904870 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:25.913932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1383/2746] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:29:26.178625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:26.180037 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:26.193124 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2924b9-fe46-4a7e-ad55-b1756e4735f1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:26.198003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:26.199786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:26.200072 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:26.200352 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] PATH_INFO: `/v3/projects/bd00fff4e7534c48ae73d024d110c1d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:26.201579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd00fff4e7534c48ae73d024d110c1d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:26.203515 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:26.251724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd00fff4e7534c48ae73d024d110c1d7', 'request_id': 'req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.258753 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd00fff4e7534c48ae73d024d110c1d7', 'request_id': 'req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.265533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd00fff4e7534c48ae73d024d110c1d7', 'request_id': 'req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.275268 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] The token cache is being invalidate because project bd00fff4e7534c48ae73d024d110c1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:26.275552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.276432 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.278016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1364/2747] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:26 2022] DELETE /identity/v3/projects/bd00fff4e7534c48ae73d024d110c1d7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:26.282204 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:26.291754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e1814-f4ff-4a52-a503-3d50c343650b service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:26.349277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:26.350206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:26.350492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:26.350799 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] PATH_INFO: `/v3/users/f1d309a5ea4b495fa9f4aab915df64f6` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:26.352077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d309a5ea4b495fa9f4aab915df64f6)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:26.354156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:26.397883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d309a5ea4b495fa9f4aab915df64f6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.405081 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d309a5ea4b495fa9f4aab915df64f6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.416214 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d309a5ea4b495fa9f4aab915df64f6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.416899 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d309a5ea4b495fa9f4aab915df64f6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.423479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-4e6bbcea-cf54-45ab-9309-2c9f7b076d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d309a5ea4b495fa9f4aab915df64f6'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.429227 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1384/2748] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:26 2022] DELETE /identity/v3/users/f1d309a5ea4b495fa9f4aab915df64f6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:26.688838 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:26.690303 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:26.703025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eb9dc-596b-49e7-92cc-70cf4d03603c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:26.760728 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:26.761712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:26.762021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:26.762299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] PATH_INFO: `/v3/projects/98b6d66bdcda44b6a121893c063b14b5` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:26.763457 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b6d66bdcda44b6a121893c063b14b5)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:26.765344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:26.810678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b6d66bdcda44b6a121893c063b14b5', 'request_id': 'req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.817537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b6d66bdcda44b6a121893c063b14b5', 'request_id': 'req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.823450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b6d66bdcda44b6a121893c063b14b5', 'request_id': 'req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.833053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] The token cache is being invalidate because project 98b6d66bdcda44b6a121893c063b14b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:26.833338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.833987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-9fbdfd74-4db4-4f7b-b665-efce6aff8c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:26.835497 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1365/2749] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:26 2022] DELETE /identity/v3/projects/98b6d66bdcda44b6a121893c063b14b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:26.840350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:26.840883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:26.840883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:26.858328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:26.859520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:26.917034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1385/2750] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:26.924956 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:26.925246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:26.925527 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:26.946125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:26.947609 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:26.956803 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1366/2751] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:26.960928 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:26.970250 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b233bb-9dcd-49b6-9cc9-86e32c023ed4 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:26.974813 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:26.975481 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:26.975764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:26.976038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:26.976749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:29:26.977063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:26.979140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:26.991133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1386/2752] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:29:26.996042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.005310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab118ab-2af2-420a-98d9-9584644c53a1 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.009916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.010564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.010848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.011197 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.012755 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.014684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.039888 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1367/2753] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:26 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:27.044087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.053684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbfc67-790a-4a51-b1e5-dc47c9e37122 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.108960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.109629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.109946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.110230 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.110911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.112833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.131996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1387/2754] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:27 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:29:27.136717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.147047 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac96a-5205-4813-8e92-fee37ba13a45 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.151951 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.152610 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.152896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.153175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.153922 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.155501 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.165567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1368/2755] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:27.169424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.179185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e98b3-6796-4760-a8f5-1d785b32b9c4 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.184328 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c104-955c-4bce-99ae-a830d7043dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.184974 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c104-955c-4bce-99ae-a830d7043dbd admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.185254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c104-955c-4bce-99ae-a830d7043dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.185530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c104-955c-4bce-99ae-a830d7043dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.186277 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c104-955c-4bce-99ae-a830d7043dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.187867 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c104-955c-4bce-99ae-a830d7043dbd admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.197723 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1388/2756] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:27.202341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.213458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8c32-a7cc-490a-b131-b8b749de365f admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.218120 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.219022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.219300 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.219572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] PATH_INFO: `/v3/projects/f03b399033d24d54a731843f2f6c5d67/users/36642d273df3488b9375580ccc345b2c/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.235128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03b399033d24d54a731843f2f6c5d67, user_id=36642d273df3488b9375580ccc345b2c, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.238183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.251206 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1369/2757] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:27 2022] PUT /identity/v3/projects/f03b399033d24d54a731843f2f6c5d67/users/36642d273df3488b9375580ccc345b2c/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:27.261797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.262132 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.262411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.288582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] MFA Rules not processed for user `36642d273df3488b9375580ccc345b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:27.289798 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:27.352617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1389/2758] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:27.356790 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.420387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4e479-ec49-46e9-9094-22f567234d6c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.425310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.425999 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.426285 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.426563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.427255 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.429704 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.466713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1370/2759] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:27 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:27.470739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.481571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4820-2e4c-4f7c-ae3d-dfdc4d58ad59 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.539322 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.539989 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.540298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.540576 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.541316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.544413 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.564217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1390/2760] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:27 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:29:27.568215 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.578615 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddaa1fa-5cad-4b68-af56-5a7fd9949873 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.583421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.584071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.584381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.584663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.585375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.586992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.598538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1371/2761] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:27.602578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.613232 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4a3fa-a9ba-40b8-b117-648d12cb8ea5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.617829 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.618734 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.619015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.619294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] PATH_INFO: `/v3/projects/3aab1f22450e461d8a02f8c2cc82513c/users/8c8007b6997b41a1b8f62466e4f385a0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.634263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aab1f22450e461d8a02f8c2cc82513c, user_id=8c8007b6997b41a1b8f62466e4f385a0, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.637282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.649772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1391/2762] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:27 2022] PUT /identity/v3/projects/3aab1f22450e461d8a02f8c2cc82513c/users/8c8007b6997b41a1b8f62466e4f385a0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:29:27.654134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.663807 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c1ebe-665b-44c8-a5de-4d3aefbbe7ab admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.717918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39724c-012c-4412-aedd-f72a9aaabc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.718522 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39724c-012c-4412-aedd-f72a9aaabc90 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.718799 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39724c-012c-4412-aedd-f72a9aaabc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.719071 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39724c-012c-4412-aedd-f72a9aaabc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.719801 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39724c-012c-4412-aedd-f72a9aaabc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.721373 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39724c-012c-4412-aedd-f72a9aaabc90 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.731183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1372/2763] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:27.735260 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.745006 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3623e-4cfc-4837-ba3c-e80dfa29025d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.749584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.750491 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.750768 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.751038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] PATH_INFO: `/v3/projects/3aab1f22450e461d8a02f8c2cc82513c/users/8c8007b6997b41a1b8f62466e4f385a0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.752953 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aab1f22450e461d8a02f8c2cc82513c, user_id=8c8007b6997b41a1b8f62466e4f385a0, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.755632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.766280 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1392/2764] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:27 2022] PUT /identity/v3/projects/3aab1f22450e461d8a02f8c2cc82513c/users/8c8007b6997b41a1b8f62466e4f385a0/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:27.777722 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.778244 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.778379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.804344 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] MFA Rules not processed for user `8c8007b6997b41a1b8f62466e4f385a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:27.805551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:27.870717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1373/2765] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:29:27.881167 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:27.883015 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:27.937995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928eb48-8c6d-45e5-9def-6a39fd6f62b2 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:27.941709 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:27.942386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:27.942676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:27.942955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:27.952830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:27.954315 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:27.963823 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1393/2766] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:28.009622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:28.011966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:28.025491 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29548c88-06cb-4dec-ba51-4240a9311c4d None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:28.031597 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873d7b8-36d9-4ca5-8583-fd69d886cd81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:28.032258 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d7b8-36d9-4ca5-8583-fd69d886cd81 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:28.032536 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d7b8-36d9-4ca5-8583-fd69d886cd81 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:28.032811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d7b8-36d9-4ca5-8583-fd69d886cd81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:28.092428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873d7b8-36d9-4ca5-8583-fd69d886cd81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:28.093876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873d7b8-36d9-4ca5-8583-fd69d886cd81 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:28.102692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1374/2767] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:31.288156 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:31.350809 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a7a6-7ca0-4384-8493-6579cda19b11 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:31.355365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:31.356352 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:31.356618 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:31.356897 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] PATH_INFO: `/v3/users/36642d273df3488b9375580ccc345b2c` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:31.358133 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=36642d273df3488b9375580ccc345b2c)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:31.360077 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:31.408432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36642d273df3488b9375580ccc345b2c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.415540 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36642d273df3488b9375580ccc345b2c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.427241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36642d273df3488b9375580ccc345b2c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.428053 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36642d273df3488b9375580ccc345b2c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.436069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36642d273df3488b9375580ccc345b2c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.441807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1394/2768] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:31 2022] DELETE /identity/v3/users/36642d273df3488b9375580ccc345b2c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:31.446310 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:31.446785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:31.447020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:31.464976 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:31.466198 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:31.522835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1375/2769] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:31.532978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:31.536550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:31.590957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5111-5591-44a4-80de-c3ad26865b1f admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:31.594601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:31.595304 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:31.595586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:31.595856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:31.605057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:31.606530 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:31.615861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1395/2770] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:31.881459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:31.883064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:31.901700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49813c01-511d-42f7-8658-1825d64e17d0 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:31.906528 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:31.908832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:31.909203 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:31.909423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] PATH_INFO: `/v3/projects/f03b399033d24d54a731843f2f6c5d67` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:31.910719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03b399033d24d54a731843f2f6c5d67)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:31.912782 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:31.963779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03b399033d24d54a731843f2f6c5d67', 'request_id': 'req-ab6a77a4-dac9-46f3-899a-471462c0763e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.972716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03b399033d24d54a731843f2f6c5d67', 'request_id': 'req-ab6a77a4-dac9-46f3-899a-471462c0763e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.979173 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03b399033d24d54a731843f2f6c5d67', 'request_id': 'req-ab6a77a4-dac9-46f3-899a-471462c0763e'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.990110 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] The token cache is being invalidate because project f03b399033d24d54a731843f2f6c5d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:31.990415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.991052 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:31.992759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1376/2771] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:31 2022] DELETE /identity/v3/projects/f03b399033d24d54a731843f2f6c5d67 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:31.997104 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:32.006775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb40b7-70af-4eb3-be10-139b0b428cb8 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:32.071594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:32.072657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.074612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.074612 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] PATH_INFO: `/v3/users/8c8007b6997b41a1b8f62466e4f385a0` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.076575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8007b6997b41a1b8f62466e4f385a0)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:32.078639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:32.134436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8007b6997b41a1b8f62466e4f385a0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.145639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8007b6997b41a1b8f62466e4f385a0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.161544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8007b6997b41a1b8f62466e4f385a0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.162487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8007b6997b41a1b8f62466e4f385a0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.170584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-21728397-4f1b-4b22-beb3-3e8e7eba51a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8007b6997b41a1b8f62466e4f385a0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.177130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1396/2772] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:31 2022] DELETE /identity/v3/users/8c8007b6997b41a1b8f62466e4f385a0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:32.451663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:32.453296 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:32.467458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a77a4-dac9-46f3-899a-471462c0763e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:32.530078 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:32.531022 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.531221 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.531498 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] PATH_INFO: `/v3/projects/3aab1f22450e461d8a02f8c2cc82513c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.533327 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aab1f22450e461d8a02f8c2cc82513c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:32.535239 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:32.587511 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aab1f22450e461d8a02f8c2cc82513c', 'request_id': 'req-15e8c050-31a6-46f1-8347-a533a542739d'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.595369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aab1f22450e461d8a02f8c2cc82513c', 'request_id': 'req-15e8c050-31a6-46f1-8347-a533a542739d'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.601612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aab1f22450e461d8a02f8c2cc82513c', 'request_id': 'req-15e8c050-31a6-46f1-8347-a533a542739d'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.611736 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] The token cache is being invalidate because project 3aab1f22450e461d8a02f8c2cc82513c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:32.612045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.612674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-15e8c050-31a6-46f1-8347-a533a542739d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:32.614436 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1377/2773] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:32 2022] DELETE /identity/v3/projects/3aab1f22450e461d8a02f8c2cc82513c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:32.619097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.619584 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.619711 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.637170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:32.638395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:32.695314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1397/2774] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:32.703774 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.704062 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.704341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.724738 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:32.725957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:32.733808 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1378/2775] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:32.738020 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:32.747731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c6dc3-be13-4b58-8044-b73b491bc636 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:32.752297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:32.752949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.753225 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.753498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.754239 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:29:32.754544 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:32.756142 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:32.768293 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1398/2776] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:29:32.772532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:32.782599 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeabba-e905-4247-bde1-c5962a720f68 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:32.787510 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:32.788160 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.788443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.788712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.789385 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:32.791324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:32.818236 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1379/2777] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:32 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:32.822580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:32.834644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c3a8-3928-48e3-868b-52c5c9ebf7a4 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:32.915455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:32.916140 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.916417 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.916692 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.917617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:32.919776 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:32.957022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1399/2778] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:32 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:29:32.958288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:32.978205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73400249-4e2e-492e-acd4-5b6fcc511391 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:32.984154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:32.984941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:32.985361 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:32.986017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:32.987011 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:32.988985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:33.004240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1380/2779] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:33.008115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:33.021507 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6c66-6099-4907-bb85-05b13afdf1b3 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:33.023222 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:33.025166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:33.028991 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:33.029955 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:33.030257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:33.030529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:33.031257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:33.034297 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:33.050733 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1400/2780] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:33.054522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:33.068059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3e58-e6e4-4ee2-a429-ea0a633bbdbf admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:33.075907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c33a-ad96-495e-a910-3ef570fed735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:33.077070 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c33a-ad96-495e-a910-3ef570fed735 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:33.077522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c33a-ad96-495e-a910-3ef570fed735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:33.077998 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c33a-ad96-495e-a910-3ef570fed735 admin admin] PATH_INFO: `/v3/projects/5f9017b6320c431c90e8734ff381e88c/users/f93bcee9bc784f2e835c9a69675625da/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:33.097242 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c33a-ad96-495e-a910-3ef570fed735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9017b6320c431c90e8734ff381e88c, user_id=f93bcee9bc784f2e835c9a69675625da, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:33.100163 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c33a-ad96-495e-a910-3ef570fed735 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:33.113896 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1401/2781] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:33 2022] PUT /identity/v3/projects/5f9017b6320c431c90e8734ff381e88c/users/f93bcee9bc784f2e835c9a69675625da/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:29:33.115746 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacf67-5450-4084-a9a9-5d04e14cd7f5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:33.118586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:33.118884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:33.119296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:33.137898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:33.139111 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:33.184732 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:33.185277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:33.185622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:33.185941 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:33.187824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:33.202082 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:33.203734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047264db-227f-4f13-bdd7-1d3e35fe7412 service placement] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:33.215855 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1381/2782] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:29:33.219003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1402/2783] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:29:33.225539 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:33.226789 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:33.291092 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399b384-b525-4063-b71e-19969fbb9b19 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:33.295282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:33.295927 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:33.296208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:33.296506 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:33.305878 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:33.307331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:33.318177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1403/2784] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:34.045504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.046400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.046902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.078032 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] MFA Rules not processed for user `f93bcee9bc784f2e835c9a69675625da`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:34.079269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:34.145208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1382/2785] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:34.149685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:34.159861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b14cd-9341-4e5c-8a62-7551cc302017 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:34.164446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:34.165106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.165391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.165669 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.166409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:34.168902 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:34.197499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1404/2786] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:29:34.201942 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:34.212289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae120e-aa2f-4904-b609-ab1cb8dc53e6 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:34.267573 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:34.268242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.268523 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.268802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.269489 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:34.271463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:34.295500 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1383/2787] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:34 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:29:34.296797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:34.308748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796ec83-9b42-465a-bce1-f17418879dd5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:34.313446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:34.314141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.314426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.314704 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.315428 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:34.317038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:34.329426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1405/2788] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:34.335737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:34.345730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bae68-07f1-4da3-b00e-f2ff31c7e9a9 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:34.350492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:34.351389 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.351675 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.351954 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] PATH_INFO: `/v3/projects/73239cda3bec4f27923179ff305410b4/users/b62040496a634f30aa57d411affba968/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.368561 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73239cda3bec4f27923179ff305410b4, user_id=b62040496a634f30aa57d411affba968, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:34.372038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:34.386920 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1384/2789] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:34 2022] PUT /identity/v3/projects/73239cda3bec4f27923179ff305410b4/users/b62040496a634f30aa57d411affba968/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:34.390906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:34.401202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a2364-d0d1-450d-b3a7-6e8c275cc2dc admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:34.459731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7bd5d-901e-40f9-a9dc-a99ba31c7fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:34.460594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7bd5d-901e-40f9-a9dc-a99ba31c7fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.460875 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7bd5d-901e-40f9-a9dc-a99ba31c7fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.461148 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7bd5d-901e-40f9-a9dc-a99ba31c7fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.461929 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7bd5d-901e-40f9-a9dc-a99ba31c7fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:34.463864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7bd5d-901e-40f9-a9dc-a99ba31c7fc2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:34.475775 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1406/2790] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:29:34.481234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:34.492225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98253c4-4198-44d3-948d-d2dc65c72dc6 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:34.496965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:34.497898 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:34.498189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:34.498462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] PATH_INFO: `/v3/projects/73239cda3bec4f27923179ff305410b4/users/b62040496a634f30aa57d411affba968/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:34.500666 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73239cda3bec4f27923179ff305410b4, user_id=b62040496a634f30aa57d411affba968, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:34.503381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:34.515297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1385/2791] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:34 2022] PUT /identity/v3/projects/73239cda3bec4f27923179ff305410b4/users/b62040496a634f30aa57d411affba968/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:29:35.244122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:35.244637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:35.244782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:35.271206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] MFA Rules not processed for user `b62040496a634f30aa57d411affba968`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:35.272623 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:35.350068 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1407/2792] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:35.362759 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:35.364998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:35.427044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa8ba3-984a-4bca-8e4d-08523a9fbc28 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:35.431380 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2f06-1b17-4b90-96cf-8eda2ab3626f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:35.432276 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2f06-1b17-4b90-96cf-8eda2ab3626f service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:35.432583 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2f06-1b17-4b90-96cf-8eda2ab3626f service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:35.432934 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2f06-1b17-4b90-96cf-8eda2ab3626f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:35.492375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2f06-1b17-4b90-96cf-8eda2ab3626f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:35.493930 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2f06-1b17-4b90-96cf-8eda2ab3626f service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:35.503565 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1386/2793] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:36.862145 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:36.863647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:36.875942 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c8ffa-cfd2-4ef8-b34b-2ba4f89b38ba None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:36.879590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:36.880303 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:36.880651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:36.880992 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:36.890960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:36.892729 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:36.903348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1408/2794] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:37.285477 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:37.286034 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:37.286175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:37.303973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] MFA Rules not processed for user `282b16dbcb1648c39afa0f7ed2d5dbda`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:37.305204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:37.363088 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1387/2795] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:50.084410 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:50.158004 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35820136-9f4d-46cb-98f9-e245316e5376 service cinder] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:50.164682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:50.165971 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:50.166432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:50.166907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] PATH_INFO: `/v3/users/f93bcee9bc784f2e835c9a69675625da` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:50.176597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93bcee9bc784f2e835c9a69675625da)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:50.180684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:50.236985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93bcee9bc784f2e835c9a69675625da'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.246026 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93bcee9bc784f2e835c9a69675625da'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.259170 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93bcee9bc784f2e835c9a69675625da'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.259949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93bcee9bc784f2e835c9a69675625da'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.266962 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93bcee9bc784f2e835c9a69675625da'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.273818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1409/2796] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:50 2022] DELETE /identity/v3/users/f93bcee9bc784f2e835c9a69675625da => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:50.461016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:50.474449 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3274a-fba7-4bdd-9bae-20ac7e5c6ada None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:50.544116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:50.545196 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:50.545487 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:50.545768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] PATH_INFO: `/v3/projects/5f9017b6320c431c90e8734ff381e88c` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:50.547286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9017b6320c431c90e8734ff381e88c)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:50.549308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:50.605982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9017b6320c431c90e8734ff381e88c', 'request_id': 'req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.613909 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9017b6320c431c90e8734ff381e88c', 'request_id': 'req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.620348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9017b6320c431c90e8734ff381e88c', 'request_id': 'req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.632028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] The token cache is being invalidate because project 5f9017b6320c431c90e8734ff381e88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:50.632315 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.632967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.634537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1388/2797] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:50 2022] DELETE /identity/v3/projects/5f9017b6320c431c90e8734ff381e88c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:50.638997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:50.640713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:50.654541 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2379-e6cd-4222-9e86-693466ac2f54 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:50.710099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:50.710981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:50.711266 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:50.711543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] PATH_INFO: `/v3/users/b62040496a634f30aa57d411affba968` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:50.712738 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62040496a634f30aa57d411affba968)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:50.714764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:50.761301 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62040496a634f30aa57d411affba968'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.769604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62040496a634f30aa57d411affba968'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.781320 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62040496a634f30aa57d411affba968'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.782039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62040496a634f30aa57d411affba968'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.789114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-ad8f4a04-e58b-4c11-99f0-b8e5562e9e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62040496a634f30aa57d411affba968'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:50.795908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1410/2798] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:50 2022] DELETE /identity/v3/users/b62040496a634f30aa57d411affba968 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:29:50.972621 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:50.974316 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:50.989024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0d92d-6168-4c05-a10b-3bcc34bae5a1 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.052850 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.053733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.054053 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.054336 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] PATH_INFO: `/v3/projects/73239cda3bec4f27923179ff305410b4` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.055614 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73239cda3bec4f27923179ff305410b4)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.057547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.106751 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73239cda3bec4f27923179ff305410b4', 'request_id': 'req-c66754fc-c8e4-4e59-bc79-c3d10826fd60'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:51.114626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73239cda3bec4f27923179ff305410b4', 'request_id': 'req-c66754fc-c8e4-4e59-bc79-c3d10826fd60'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:51.121935 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73239cda3bec4f27923179ff305410b4', 'request_id': 'req-c66754fc-c8e4-4e59-bc79-c3d10826fd60'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:51.133758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] The token cache is being invalidate because project 73239cda3bec4f27923179ff305410b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:51.134175 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:51.135012 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c66754fc-c8e4-4e59-bc79-c3d10826fd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:51.136748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1389/2799] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:50 2022] DELETE /identity/v3/projects/73239cda3bec4f27923179ff305410b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:51.141786 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.142337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.142471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.160459 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:51.161644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:51.221141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1411/2800] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:51.229298 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.229590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.229890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.252127 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:51.253362 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:51.263540 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1390/2801] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:51.267421 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.279624 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6a624-75c6-4809-b668-26309c7e0e1d None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.291217 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.291889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.292178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.292469 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.293769 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:29:51.294568 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.296249 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.311831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1412/2802] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:29:51.316312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.326716 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254608a-8d0a-4fee-b151-74dda990fc32 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.332347 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.333009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.333291 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.333563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.334290 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.336512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.367673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1391/2803] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:51.368708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.378912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcc214-30d7-4bfa-b79c-84b784ec23a5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.435570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.436273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.436559 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.436841 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.437545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.439555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.460580 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1413/2804] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:51.465133 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.476887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4288a67-5ccd-42d6-9add-471f838d2f92 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.483208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.484121 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.484592 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.485042 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.485770 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.487590 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.498390 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1392/2805] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:51.502591 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.513264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464386f-b5e9-4f5c-b9ba-ceb9f45b7c6c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.518212 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ad85-9633-4330-9063-b5641b63207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.518849 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ad85-9633-4330-9063-b5641b63207c admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.519131 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ad85-9633-4330-9063-b5641b63207c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.519404 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ad85-9633-4330-9063-b5641b63207c admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.520113 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ad85-9633-4330-9063-b5641b63207c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.521739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ad85-9633-4330-9063-b5641b63207c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.532385 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1414/2806] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:51.536471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.546462 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563b3c4-78f0-415e-a554-12b3dab37fab admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.551154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.552029 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.552309 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.552586 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] PATH_INFO: `/v3/projects/3f7411bb85214ed6ab3d3cdb18e75f1c/users/5092d40752844820bef76b31a8ae48e0/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.567001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7411bb85214ed6ab3d3cdb18e75f1c, user_id=5092d40752844820bef76b31a8ae48e0, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.569700 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.582518 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1393/2807] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:51 2022] PUT /identity/v3/projects/3f7411bb85214ed6ab3d3cdb18e75f1c/users/5092d40752844820bef76b31a8ae48e0/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:51.642139 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.642345 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.642590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.669818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] MFA Rules not processed for user `5092d40752844820bef76b31a8ae48e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:51.671044 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:51.732881 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1415/2808] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:51.737914 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.799238 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f50a-6c5a-4324-adac-f22305caffef admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.803950 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.804603 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.804890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.805172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.805883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.807824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.834454 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1394/2809] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:51.837892 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.848455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327bf97-07ab-4c48-8fca-71e842107ad8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.902603 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.903190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.903473 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.903748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.904432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.906392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.925569 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1416/2810] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:51 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:29:51.929665 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.940883 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e765-a915-4644-bbc0-53f7623e15df admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.945626 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.946470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.946758 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.947041 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.947795 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.949988 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:51.960879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1395/2811] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:51.965292 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:51.975059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28879c11-d2c1-4937-bcb5-322031220dd1 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:51.979701 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:51.980794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:51.981079 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:51.981358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] PATH_INFO: `/v3/projects/784fb79df53a4db58fd5b22a6402b045/users/047271a8796e43058499e024382e35c2/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:51.996158 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784fb79df53a4db58fd5b22a6402b045, user_id=047271a8796e43058499e024382e35c2, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:51.998913 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:52.012291 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1417/2812] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:51 2022] PUT /identity/v3/projects/784fb79df53a4db58fd5b22a6402b045/users/047271a8796e43058499e024382e35c2/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:52.016287 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:52.027122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda0e92-747f-4b4b-9b18-bb2d697071bd admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:52.086611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b309a-1e56-474e-a4db-652e031b7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:52.087279 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b309a-1e56-474e-a4db-652e031b7497 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:52.087568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b309a-1e56-474e-a4db-652e031b7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:52.087849 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b309a-1e56-474e-a4db-652e031b7497 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:52.088566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b309a-1e56-474e-a4db-652e031b7497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:52.090234 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b309a-1e56-474e-a4db-652e031b7497 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:52.100832 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1396/2813] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:52.105637 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:52.116251 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c11f39-26b7-423d-9f2d-bee4787434c5 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:52.121498 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:52.122441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:52.122721 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:52.122995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] PATH_INFO: `/v3/projects/784fb79df53a4db58fd5b22a6402b045/users/047271a8796e43058499e024382e35c2/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:52.125027 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784fb79df53a4db58fd5b22a6402b045, user_id=047271a8796e43058499e024382e35c2, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:52.127763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:52.137835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1418/2814] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:52 2022] PUT /identity/v3/projects/784fb79df53a4db58fd5b22a6402b045/users/047271a8796e43058499e024382e35c2/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:52.147895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:52.148205 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:52.148472 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:52.176263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] MFA Rules not processed for user `047271a8796e43058499e024382e35c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:52.177467 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:52.242672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1397/2815] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:52.254478 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:52.256258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:52.311859 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77582-0c48-4ae3-96bf-c8b209bc9d89 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:52.315445 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac1c1e-d136-49b9-94c1-984c5b82cee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:52.316076 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac1c1e-d136-49b9-94c1-984c5b82cee7 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:52.316356 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac1c1e-d136-49b9-94c1-984c5b82cee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:52.316632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac1c1e-d136-49b9-94c1-984c5b82cee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:52.370555 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac1c1e-d136-49b9-94c1-984c5b82cee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:52.372680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac1c1e-d136-49b9-94c1-984c5b82cee7 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:52.381636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1419/2816] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:54.878913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:54.943466 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a00b8-7588-49ac-8183-53b38172ab94 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:54.948382 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:54.949326 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:54.949628 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:54.950697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] PATH_INFO: `/v3/users/5092d40752844820bef76b31a8ae48e0` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:54.951961 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5092d40752844820bef76b31a8ae48e0)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:54.953994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:55.000585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5092d40752844820bef76b31a8ae48e0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.007092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5092d40752844820bef76b31a8ae48e0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.019269 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5092d40752844820bef76b31a8ae48e0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.019887 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5092d40752844820bef76b31a8ae48e0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.020486 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5092d40752844820bef76b31a8ae48e0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.032669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1398/2817] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:54 2022] DELETE /identity/v3/users/5092d40752844820bef76b31a8ae48e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:55.037739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:55.038262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:55.038380 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:55.055601 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:55.056830 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:55.116890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1420/2818] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:55.126969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:55.128363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:55.183116 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ebe4c-0a44-40e4-84ec-c4fee25861f3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:55.187424 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:55.188064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:55.188350 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:55.188630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:55.197693 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:55.199168 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:55.209227 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1399/2819] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:29:55.461409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:55.462915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:55.476369 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2a56-788a-4660-88ff-17972ebb177f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:55.481746 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:55.483418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:55.483418 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:55.483719 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] PATH_INFO: `/v3/projects/3f7411bb85214ed6ab3d3cdb18e75f1c` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:55.484898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7411bb85214ed6ab3d3cdb18e75f1c)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:55.486850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:55.533515 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7411bb85214ed6ab3d3cdb18e75f1c', 'request_id': 'req-d80970d4-eeaa-409a-aee3-fa4ba5844d93'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.539792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7411bb85214ed6ab3d3cdb18e75f1c', 'request_id': 'req-d80970d4-eeaa-409a-aee3-fa4ba5844d93'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.546267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7411bb85214ed6ab3d3cdb18e75f1c', 'request_id': 'req-d80970d4-eeaa-409a-aee3-fa4ba5844d93'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.556248 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] The token cache is being invalidate because project 3f7411bb85214ed6ab3d3cdb18e75f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:55.556564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.557219 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.558797 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1421/2820] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:55 2022] DELETE /identity/v3/projects/3f7411bb85214ed6ab3d3cdb18e75f1c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:29:55.563606 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:55.572952 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e69c-a9e4-4e38-91e9-409d568ecb3b service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:55.626568 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:55.627433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:55.627713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:55.627987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] PATH_INFO: `/v3/users/047271a8796e43058499e024382e35c2` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:55.629143 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047271a8796e43058499e024382e35c2)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:55.631063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:55.677620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047271a8796e43058499e024382e35c2'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.685516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047271a8796e43058499e024382e35c2'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.696796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047271a8796e43058499e024382e35c2'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.697415 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047271a8796e43058499e024382e35c2'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.698024 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b37a9268-34f1-4af7-bcd5-5b8393c78367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047271a8796e43058499e024382e35c2'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:55.710413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1400/2821] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:29:55 2022] DELETE /identity/v3/users/047271a8796e43058499e024382e35c2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:56.001215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.002713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:56.016153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80970d4-eeaa-409a-aee3-fa4ba5844d93 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.072731 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.073590 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.073939 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.074208 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] PATH_INFO: `/v3/projects/784fb79df53a4db58fd5b22a6402b045` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.075467 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784fb79df53a4db58fd5b22a6402b045)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.077361 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.120636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784fb79df53a4db58fd5b22a6402b045', 'request_id': 'req-5a9246fc-e010-4ad9-b557-c0d575135569'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:56.127520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784fb79df53a4db58fd5b22a6402b045', 'request_id': 'req-5a9246fc-e010-4ad9-b557-c0d575135569'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:56.133621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784fb79df53a4db58fd5b22a6402b045', 'request_id': 'req-5a9246fc-e010-4ad9-b557-c0d575135569'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:56.143906 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] The token cache is being invalidate because project 784fb79df53a4db58fd5b22a6402b045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:29:56.144187 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:56.144803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-5a9246fc-e010-4ad9-b557-c0d575135569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:29:56.146373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1422/2822] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:29:56 2022] DELETE /identity/v3/projects/784fb79df53a4db58fd5b22a6402b045 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:29:56.151620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.152097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.152259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.170927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:56.172106 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:56.227918 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1401/2823] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:56.236466 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.236705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.237087 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.256479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:56.257682 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:56.265812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1423/2824] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:56.270114 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.280591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621c808-0186-4f2c-aec3-e39e00b46507 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.285142 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.285789 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.286104 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.286381 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.287092 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:29:56.287400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.288982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.300881 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1402/2825] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:29:56.305147 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.314216 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756981d-420f-4f9c-a12b-8aa6659bc78b None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.318818 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.319456 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.319743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.320018 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.320706 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.322651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.350247 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1424/2826] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:29:56 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:56.354360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.364712 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f759a0-823d-498e-b38d-5a3ad7a2a8d3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.417875 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.418848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.419134 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.419410 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.420089 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.422020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.441038 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1403/2827] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:29:56 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:29:56.445114 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.456108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac930-f398-4ca6-9a0a-eb54dbd92466 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.460735 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.461388 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.461670 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.461978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.462710 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.464288 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.474760 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1425/2828] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:56.478576 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.488493 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c398e-ade1-44a2-b8ae-472ee4299c1c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.493033 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ed222-a8ec-4f14-8c39-19e0507975bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.493673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed222-a8ec-4f14-8c39-19e0507975bf admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.493992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed222-a8ec-4f14-8c39-19e0507975bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.494267 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed222-a8ec-4f14-8c39-19e0507975bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.494972 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed222-a8ec-4f14-8c39-19e0507975bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.497247 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed222-a8ec-4f14-8c39-19e0507975bf admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.506895 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1404/2829] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:29:56.510860 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.521335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b589-997e-4a25-9ab2-e74f143a9367 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.526355 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.527220 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.527520 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.528017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] PATH_INFO: `/v3/projects/f607a5ab41e54f05b9364ec540c6e96b/users/3830240ef78d42aead0e9801a5be5af1/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.542043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f607a5ab41e54f05b9364ec540c6e96b, user_id=3830240ef78d42aead0e9801a5be5af1, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.545391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.557492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1426/2830] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:29:56 2022] PUT /identity/v3/projects/f607a5ab41e54f05b9364ec540c6e96b/users/3830240ef78d42aead0e9801a5be5af1/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:29:56.569289 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.569579 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.569868 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.595392 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] MFA Rules not processed for user `3830240ef78d42aead0e9801a5be5af1`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:29:56.596569 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:56.658374 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1405/2831] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:29:56.670684 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:29:56.672376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:29:56.727934 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4517c-5b4f-4949-a3ed-5328ed80edea admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:29:56.731883 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35643347-077d-45bf-99cb-3a7e0ca06389 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7848c76d664adc9df92ab214c0c7f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:29:56.732485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643347-077d-45bf-99cb-3a7e0ca06389 service glance] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:29:56.732772 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643347-077d-45bf-99cb-3a7e0ca06389 service glance] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:29:56.733049 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643347-077d-45bf-99cb-3a7e0ca06389 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:29:56.741191 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35643347-077d-45bf-99cb-3a7e0ca06389 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:29:56.742659 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35643347-077d-45bf-99cb-3a7e0ca06389 service glance] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:29:56.751354 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1427/2832] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:28.737214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:28.799056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d55928-8a9d-4d85-80c1-a7e6741e65af None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:28.803819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:28.804690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:28.804973 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:28.805252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] PATH_INFO: `/v3/users/3830240ef78d42aead0e9801a5be5af1` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:28.806463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3830240ef78d42aead0e9801a5be5af1)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:28.808367 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:28.852768 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3830240ef78d42aead0e9801a5be5af1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:28.859064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3830240ef78d42aead0e9801a5be5af1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:28.870816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3830240ef78d42aead0e9801a5be5af1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:28.871452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3830240ef78d42aead0e9801a5be5af1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:28.872056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3830240ef78d42aead0e9801a5be5af1'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:28.883937 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1406/2833] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:30:28 2022] DELETE /identity/v3/users/3830240ef78d42aead0e9801a5be5af1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:28.888425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:28.888917 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:28.889033 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:28.906366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:28.907550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:28.964392 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1428/2834] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:28.975126 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:28.976570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:29.032379 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988078c6-7202-42a0-b09f-9d70e2a2b21c admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:29.036805 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:29.037434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:29.037717 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:29.038025 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:29.046727 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:29.048141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:29.057987 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1407/2835] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:29.317602 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:29.319041 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:29.330725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55c107-aab1-412f-ac09-121449a5f383 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:29.336411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:29.337510 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:29.337796 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:29.338096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] PATH_INFO: `/v3/projects/f607a5ab41e54f05b9364ec540c6e96b` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:29.339278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f607a5ab41e54f05b9364ec540c6e96b)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:29.341193 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:29.390258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f607a5ab41e54f05b9364ec540c6e96b', 'request_id': 'req-511fdd16-78d2-49f1-977b-acdf8429a158'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:29.398153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f607a5ab41e54f05b9364ec540c6e96b', 'request_id': 'req-511fdd16-78d2-49f1-977b-acdf8429a158'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:29.404310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f607a5ab41e54f05b9364ec540c6e96b', 'request_id': 'req-511fdd16-78d2-49f1-977b-acdf8429a158'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:29.415178 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] The token cache is being invalidate because project f607a5ab41e54f05b9364ec540c6e96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:30:29.415463 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:29.416090 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:29.417606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1429/2836] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:30:29 2022] DELETE /identity/v3/projects/f607a5ab41e54f05b9364ec540c6e96b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:56.461452 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:56.462980 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:56.476705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb2471-0934-4cdd-bb98-a124231dc2a7 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:56.531112 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:56.531970 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:56.532246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:56.532516 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] PATH_INFO: `/v3/users/282b16dbcb1648c39afa0f7ed2d5dbda` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:56.533673 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282b16dbcb1648c39afa0f7ed2d5dbda)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:56.535824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:56.586118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282b16dbcb1648c39afa0f7ed2d5dbda'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.593913 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282b16dbcb1648c39afa0f7ed2d5dbda'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.608767 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282b16dbcb1648c39afa0f7ed2d5dbda'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.609812 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282b16dbcb1648c39afa0f7ed2d5dbda'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.610845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-d7bf046c-e14d-40fc-99cd-50775efb4144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282b16dbcb1648c39afa0f7ed2d5dbda'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.625713 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1408/2837] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:30:56 2022] DELETE /identity/v3/users/282b16dbcb1648c39afa0f7ed2d5dbda => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:56.803095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:56.804564 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:56.818411 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fdd16-78d2-49f1-977b-acdf8429a158 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:56.873828 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:56.874713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:56.874995 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:56.875264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] PATH_INFO: `/v3/projects/e4bf1dc206f041ca91a40149aab30dee` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:56.876427 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bf1dc206f041ca91a40149aab30dee)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:56.878366 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:56.923330 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bf1dc206f041ca91a40149aab30dee', 'request_id': 'req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.930235 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bf1dc206f041ca91a40149aab30dee', 'request_id': 'req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.936259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bf1dc206f041ca91a40149aab30dee', 'request_id': 'req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.946765 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] The token cache is being invalidate because project e4bf1dc206f041ca91a40149aab30dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:30:56.947052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.947698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-3efe9f7c-35c8-4e57-8bce-90b36a9e7fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:56.949335 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1430/2838] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:30:56 2022] DELETE /identity/v3/projects/e4bf1dc206f041ca91a40149aab30dee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:56.954181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:56.954469 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:56.954745 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:56.973509 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:56.974739 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:57.031779 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1409/2839] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:57.040636 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.040915 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.041192 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.060981 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:57.062188 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:57.071097 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1431/2840] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:57.075226 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.085306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ddedd-a2e5-4f3c-b9d6-db8fb913b7dd None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.089836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.090505 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.090791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.091067 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.091777 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:30:57.092083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.093667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.105263 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1410/2841] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:30:57.109386 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.118657 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c580a-1704-471a-95e3-afe3e008a978 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.123359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.124000 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.124289 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.124563 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.125241 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.127184 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.153185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1432/2842] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:30:57.157122 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.167009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5faf-e7cb-4099-a387-3b3572967d22 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.222570 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.223154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.223441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.223715 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.224399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.226338 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.246189 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1411/2843] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:30:57.250359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.261273 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91547aad-bfb3-4279-af05-86dd3c9787fa admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.266061 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.266725 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.267021 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.267323 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.268039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.270350 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.280834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1433/2844] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:57.284776 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.294664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b6bc1-6ce9-466c-9671-9bec7643adc3 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.299288 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17053d13-aa7f-4fa6-8e16-866be5d32736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.299936 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17053d13-aa7f-4fa6-8e16-866be5d32736 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.300223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17053d13-aa7f-4fa6-8e16-866be5d32736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.300508 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17053d13-aa7f-4fa6-8e16-866be5d32736 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.301329 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17053d13-aa7f-4fa6-8e16-866be5d32736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.302957 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17053d13-aa7f-4fa6-8e16-866be5d32736 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.312836 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1412/2845] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:57.317309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.326954 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f377d-bf4d-4759-836b-f1317b01937f admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.331547 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.333069 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.333349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.333626 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] PATH_INFO: `/v3/projects/26f3bfb4420f4a17bbd93f3f781ee689/users/5406debd17a744bb9e4784f79fb39d75/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.347641 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f3bfb4420f4a17bbd93f3f781ee689, user_id=5406debd17a744bb9e4784f79fb39d75, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.350331 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.364048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1434/2846] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:30:57 2022] PUT /identity/v3/projects/26f3bfb4420f4a17bbd93f3f781ee689/users/5406debd17a744bb9e4784f79fb39d75/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:57.373917 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.374208 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.374488 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.402549 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] MFA Rules not processed for user `5406debd17a744bb9e4784f79fb39d75`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:57.403816 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:57.464756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1413/2847] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:57.469244 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.527433 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce656-1a6d-46f0-92be-ff18959b908d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.532030 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.532676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.532957 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.533231 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.533932 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.536075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.560126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1435/2848] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:30:57.564275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.575314 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95594c2f-d9a0-4396-b1db-47f88dd458ef None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.628446 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.629690 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.630005 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.630286 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.630977 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.632870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.651964 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1414/2849] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:30:57.655866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.665947 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe59cb-208b-4514-a7c4-1a60d8787468 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.670457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.671099 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.671378 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.671651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.672359 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.674085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.684831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1436/2850] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:57.688794 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.699630 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274ddaa-240d-4735-a853-07fde47bae0d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.704461 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.705346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.705654 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.706020 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] PATH_INFO: `/v3/projects/17bc9e7f37e845cd807ce51c66fed54a/users/5a375c1fc97f4adeaf9d43113caa3b21/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.720431 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bc9e7f37e845cd807ce51c66fed54a, user_id=5a375c1fc97f4adeaf9d43113caa3b21, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.723101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.735016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1415/2851] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:30:57 2022] PUT /identity/v3/projects/17bc9e7f37e845cd807ce51c66fed54a/users/5a375c1fc97f4adeaf9d43113caa3b21/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:57.739578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.749101 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7a9de-d610-4fbc-87f0-9892f106f4c6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.803319 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf5103-35fc-4607-ae2b-d80f5d6e55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.803964 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf5103-35fc-4607-ae2b-d80f5d6e55ab admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.804181 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf5103-35fc-4607-ae2b-d80f5d6e55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.804455 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf5103-35fc-4607-ae2b-d80f5d6e55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.805168 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf5103-35fc-4607-ae2b-d80f5d6e55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.807045 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf5103-35fc-4607-ae2b-d80f5d6e55ab admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.817115 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1437/2852] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:57.821444 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.831393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffc9e6-f78e-4a16-8232-8800d495e908 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:57.836532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:57.837400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.837681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.837990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] PATH_INFO: `/v3/projects/17bc9e7f37e845cd807ce51c66fed54a/users/5a375c1fc97f4adeaf9d43113caa3b21/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.839894 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bc9e7f37e845cd807ce51c66fed54a, user_id=5a375c1fc97f4adeaf9d43113caa3b21, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:57.842551 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:57.852811 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1416/2853] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:30:57 2022] PUT /identity/v3/projects/17bc9e7f37e845cd807ce51c66fed54a/users/5a375c1fc97f4adeaf9d43113caa3b21/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:57.862914 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:57.863210 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:57.863492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:57.889447 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] MFA Rules not processed for user `5a375c1fc97f4adeaf9d43113caa3b21`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:57.890698 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:57.955571 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1438/2854] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:57.966783 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:57.968428 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:58.023703 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52618f-29ed-436d-a81b-c026df66e8a5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:58.027531 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1e700-5c18-4599-9896-07c07bd4e6d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:58.028157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1e700-5c18-4599-9896-07c07bd4e6d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.028434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1e700-5c18-4599-9896-07c07bd4e6d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.028705 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1e700-5c18-4599-9896-07c07bd4e6d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.037641 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1e700-5c18-4599-9896-07c07bd4e6d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:58.039084 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1e700-5c18-4599-9896-07c07bd4e6d4 service cinder] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:58.048064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1417/2855] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:58.175395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:58.234176 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd7aff-8bf3-460b-8332-628cdd3f2dfe None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:58.239396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:58.240255 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.240543 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.240814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] PATH_INFO: `/v3/users/5406debd17a744bb9e4784f79fb39d75` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.242237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5406debd17a744bb9e4784f79fb39d75)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:58.244482 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:58.289233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5406debd17a744bb9e4784f79fb39d75'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.295963 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5406debd17a744bb9e4784f79fb39d75'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.308336 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5406debd17a744bb9e4784f79fb39d75'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.308925 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5406debd17a744bb9e4784f79fb39d75'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.315313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5406debd17a744bb9e4784f79fb39d75'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.322206 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1439/2856] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:30:58 2022] DELETE /identity/v3/users/5406debd17a744bb9e4784f79fb39d75 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:58.326827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.327118 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.327399 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.345083 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:58.346312 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:58.405257 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1418/2857] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:58.415135 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:58.416548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:58.471063 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f81b41-21d4-40a5-a973-2cba003764f2 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:58.474675 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:58.475314 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.475594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.475866 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.484639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:58.486102 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:58.495803 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1440/2858] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:58.751475 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:58.752940 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:58.766334 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28574c20-0768-4c5d-9e05-c10b872076e9 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:58.771081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:58.771997 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.772275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.772552 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] PATH_INFO: `/v3/projects/26f3bfb4420f4a17bbd93f3f781ee689` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.773748 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f3bfb4420f4a17bbd93f3f781ee689)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:58.775967 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:58.823969 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f3bfb4420f4a17bbd93f3f781ee689', 'request_id': 'req-4641888b-5310-451b-a781-a27f59ec2709'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.830714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f3bfb4420f4a17bbd93f3f781ee689', 'request_id': 'req-4641888b-5310-451b-a781-a27f59ec2709'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.837157 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f3bfb4420f4a17bbd93f3f781ee689', 'request_id': 'req-4641888b-5310-451b-a781-a27f59ec2709'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.846896 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] The token cache is being invalidate because project 26f3bfb4420f4a17bbd93f3f781ee689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:30:58.847186 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.848433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.849989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1419/2859] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:30:58 2022] DELETE /identity/v3/projects/26f3bfb4420f4a17bbd93f3f781ee689 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:58.853960 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:58.864276 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a1cf-c573-4a70-beb9-654011b544e1 service neutron] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:58.918519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:58.919431 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.919713 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.919990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] PATH_INFO: `/v3/users/5a375c1fc97f4adeaf9d43113caa3b21` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.921169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a375c1fc97f4adeaf9d43113caa3b21)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:58.923149 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:58.968807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a375c1fc97f4adeaf9d43113caa3b21'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.977390 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a375c1fc97f4adeaf9d43113caa3b21'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.990264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a375c1fc97f4adeaf9d43113caa3b21'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.990903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a375c1fc97f4adeaf9d43113caa3b21'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:58.997759 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-0f84d7ec-050b-4db2-b818-7d4af3bca2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a375c1fc97f4adeaf9d43113caa3b21'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:59.003613 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1441/2860] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:30:58 2022] DELETE /identity/v3/users/5a375c1fc97f4adeaf9d43113caa3b21 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:59.271463 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.272897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:59.289076 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641888b-5310-451b-a781-a27f59ec2709 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.344804 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.345674 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.346000 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.346283 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] PATH_INFO: `/v3/projects/17bc9e7f37e845cd807ce51c66fed54a` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.347468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=17bc9e7f37e845cd807ce51c66fed54a)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.349719 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.393679 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bc9e7f37e845cd807ce51c66fed54a', 'request_id': 'req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:59.401797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bc9e7f37e845cd807ce51c66fed54a', 'request_id': 'req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:59.407819 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bc9e7f37e845cd807ce51c66fed54a', 'request_id': 'req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:59.417900 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] The token cache is being invalidate because project 17bc9e7f37e845cd807ce51c66fed54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:30:59.418193 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:59.418835 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-b1acf994-ca3e-4dbf-a6e2-3ea6ee6cd4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:30:59.420345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1420/2861] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:30:59 2022] DELETE /identity/v3/projects/17bc9e7f37e845cd807ce51c66fed54a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:30:59.425141 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.425446 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.425739 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.444093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:59.445296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:59.501994 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1442/2862] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:59.511140 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.511433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.511714 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.530141 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:59.531331 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:59.540049 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1421/2863] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:59.544294 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.554257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0ea41-feb4-4096-bf64-f73af512189e None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.558764 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.559402 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.559680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.559951 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] PATH_INFO: `/v3/domains` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.560654 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:30:59.560956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.562582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.573519 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1443/2864] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:30:59.578056 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.587584 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa2b26-8dfd-4686-8437-055fe0f5627a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.592172 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.592809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.593093 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.593366 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.594081 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.595998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.621907 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1422/2865] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:30:59 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:30:59.626324 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.636556 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d270bc-85f0-49e0-907f-153caed1660d admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.690779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.691608 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.691885 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.692223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.692912 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.694861 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.714707 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1444/2866] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:30:59 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:30:59.718785 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.729328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939f8d-ba1e-4abf-884a-cc15016f1fa5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.733927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.734577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.734890 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.735167 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.735877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.737459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.748040 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1423/2867] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:59.751907 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.761653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e67aa-d6ca-4191-9729-8415ceec68c8 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.766205 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254cac6-eef4-4395-b526-0f69360a5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.766844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254cac6-eef4-4395-b526-0f69360a5931 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.767122 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254cac6-eef4-4395-b526-0f69360a5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.767391 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254cac6-eef4-4395-b526-0f69360a5931 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.768096 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254cac6-eef4-4395-b526-0f69360a5931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.770196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254cac6-eef4-4395-b526-0f69360a5931 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.779908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1445/2868] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:59.783879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.794261 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b68c5-abd3-4955-9bb6-dc5f0226cd40 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.798859 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.799740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.800028 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.800308 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] PATH_INFO: `/v3/projects/063a76132b90402dab22f176d3c48b6e/users/d4bae62a0cb84bcfb6023d823dcc97dd/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.814533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=063a76132b90402dab22f176d3c48b6e, user_id=d4bae62a0cb84bcfb6023d823dcc97dd, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.817181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.829369 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1424/2869] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:30:59 2022] PUT /identity/v3/projects/063a76132b90402dab22f176d3c48b6e/users/d4bae62a0cb84bcfb6023d823dcc97dd/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:30:59.839918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.840215 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.840525 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.867052 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] MFA Rules not processed for user `d4bae62a0cb84bcfb6023d823dcc97dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:59.868261 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:59.931116 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1446/2870] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:59.935468 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.995862 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6d19-9b22-4306-8ce3-546b442f8e7d admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.000542 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.001192 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.001479 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.001756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.002473 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.004450 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.029010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1425/2871] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:30:59 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:00.033057 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.044100 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5626-299d-4595-ae53-f62857681fc3 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.097864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.098548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.098862 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.099126 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] PATH_INFO: `/v3/users` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.099850 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.101785 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.120487 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1447/2872] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:31:00 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:00.124423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.136802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c3e14-5af8-42af-89ad-183e08892c6b admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.141413 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.142090 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.142375 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.142648 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.143356 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.145672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.156407 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1426/2873] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:31:00.160594 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.170472 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433525-b990-42fd-a9f6-c7d6f5d7a36e admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.175833 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.176730 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.177043 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.177353 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] PATH_INFO: `/v3/projects/5bf0416399fb4968a980502fec581c66/users/5e3a4d19185247b0986ac750d6cf0822/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.194016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf0416399fb4968a980502fec581c66, user_id=5e3a4d19185247b0986ac750d6cf0822, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.196655 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.209794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1448/2874] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:31:00 2022] PUT /identity/v3/projects/5bf0416399fb4968a980502fec581c66/users/5e3a4d19185247b0986ac750d6cf0822/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:31:00.213928 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.224204 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b6f9-b8b6-46aa-9d5c-3e6f2354dca5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.285427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437622c-be0e-41c3-b554-bc71b774cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.286103 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437622c-be0e-41c3-b554-bc71b774cb46 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.286470 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437622c-be0e-41c3-b554-bc71b774cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.286747 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437622c-be0e-41c3-b554-bc71b774cb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.287458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437622c-be0e-41c3-b554-bc71b774cb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.289031 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437622c-be0e-41c3-b554-bc71b774cb46 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.298791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1427/2875] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:31:00.303278 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.313373 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10700814-d818-4b00-8697-5fa147fbbc7a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.318634 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.319508 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.319784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.320058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] PATH_INFO: `/v3/projects/5bf0416399fb4968a980502fec581c66/users/5e3a4d19185247b0986ac750d6cf0822/roles/a8acc8ba06f94cc78a1bcb22d8f1d819` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.322036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf0416399fb4968a980502fec581c66, user_id=5e3a4d19185247b0986ac750d6cf0822, role_id=a8acc8ba06f94cc78a1bcb22d8f1d819)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.324652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.335166 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1449/2876] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:31:00 2022] PUT /identity/v3/projects/5bf0416399fb4968a980502fec581c66/users/5e3a4d19185247b0986ac750d6cf0822/roles/a8acc8ba06f94cc78a1bcb22d8f1d819 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:00.346039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.346346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.346623 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.372046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] MFA Rules not processed for user `5e3a4d19185247b0986ac750d6cf0822`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:00.373228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:00.439529 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1428/2877] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:00.451348 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.453059 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:00.509438 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d88f7-3632-4106-9430-3e5a2275add6 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.513106 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa644-fbd5-4b2c-8364-c3d8def1de2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.513720 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa644-fbd5-4b2c-8364-c3d8def1de2e service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.514034 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa644-fbd5-4b2c-8364-c3d8def1de2e service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.514313 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa644-fbd5-4b2c-8364-c3d8def1de2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.523091 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aa644-fbd5-4b2c-8364-c3d8def1de2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.524792 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aa644-fbd5-4b2c-8364-c3d8def1de2e service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.533935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1450/2878] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:00.560885 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.622319 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cc33-eb1a-44f2-8e3a-6f1e6c56a0e7 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.626857 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.627724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.628001 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.628274 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] PATH_INFO: `/v3/users/d4bae62a0cb84bcfb6023d823dcc97dd` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.630668 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bae62a0cb84bcfb6023d823dcc97dd)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.632571 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.677391 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bae62a0cb84bcfb6023d823dcc97dd'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:00.683591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bae62a0cb84bcfb6023d823dcc97dd'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:00.695471 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bae62a0cb84bcfb6023d823dcc97dd'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:00.696174 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bae62a0cb84bcfb6023d823dcc97dd'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:00.696737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bae62a0cb84bcfb6023d823dcc97dd'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:00.708132 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1429/2879] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:31:00 2022] DELETE /identity/v3/users/d4bae62a0cb84bcfb6023d823dcc97dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:00.712750 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.713042 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.713321 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.730771 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:00.731959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:00.788886 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1451/2880] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:00.798360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:00.799730 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:00.855339 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c2a8e-99d7-4eae-a073-6b6e2ff81bf0 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:00.859021 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:00.859663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:00.859948 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:00.860228 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:00.870458 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:00.871870 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:00.881504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1430/2881] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:01.136781 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:01.138316 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:01.150751 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ffbea-75ac-45c3-b99c-9dd2c3ef62a9 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:01.155376 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:01.156237 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.156545 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.157233 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] PATH_INFO: `/v3/projects/063a76132b90402dab22f176d3c48b6e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.158835 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=063a76132b90402dab22f176d3c48b6e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:01.161752 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:01.207093 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063a76132b90402dab22f176d3c48b6e', 'request_id': 'req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.213996 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063a76132b90402dab22f176d3c48b6e', 'request_id': 'req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.220038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063a76132b90402dab22f176d3c48b6e', 'request_id': 'req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.230357 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] The token cache is being invalidate because project 063a76132b90402dab22f176d3c48b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:31:01.230646 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.231285 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.232807 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1452/2882] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:31:01 2022] DELETE /identity/v3/projects/063a76132b90402dab22f176d3c48b6e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:01.236772 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:01.246663 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edadc5-5a00-420a-a45a-04e955731197 service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:01.300874 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:01.301697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.302017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.302297 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] PATH_INFO: `/v3/users/5e3a4d19185247b0986ac750d6cf0822` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.303484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3a4d19185247b0986ac750d6cf0822)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:01.305393 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:01.349593 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3a4d19185247b0986ac750d6cf0822'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.356324 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3a4d19185247b0986ac750d6cf0822'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.368434 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3a4d19185247b0986ac750d6cf0822'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.369074 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3a4d19185247b0986ac750d6cf0822'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.369669 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-ba756eba-53c6-4707-9477-36001bdc10e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3a4d19185247b0986ac750d6cf0822'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.381441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1431/2883] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:31:01 2022] DELETE /identity/v3/users/5e3a4d19185247b0986ac750d6cf0822 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:01.645562 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:01.647009 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:01.659727 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a8b8d-e59a-4dc4-a35f-9ce4b5189a5c admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:01.716396 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:01.717254 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.717529 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.717794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] PATH_INFO: `/v3/projects/5bf0416399fb4968a980502fec581c66` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.718985 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf0416399fb4968a980502fec581c66)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:01.720868 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:01.765685 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf0416399fb4968a980502fec581c66', 'request_id': 'req-d6d497f7-02fd-423e-a1a2-ec974452807c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.773782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf0416399fb4968a980502fec581c66', 'request_id': 'req-d6d497f7-02fd-423e-a1a2-ec974452807c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.779999 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf0416399fb4968a980502fec581c66', 'request_id': 'req-d6d497f7-02fd-423e-a1a2-ec974452807c'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.790644 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] The token cache is being invalidate because project 5bf0416399fb4968a980502fec581c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:31:01.791003 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.791794 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d6d497f7-02fd-423e-a1a2-ec974452807c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:01.793784 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1453/2884] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:31:01 2022] DELETE /identity/v3/projects/5bf0416399fb4968a980502fec581c66 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:01.798750 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.799275 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.799414 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.817681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:01.818902 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:01.874016 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1432/2885] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:01.882424 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.882717 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.883024 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.901812 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:01.903037 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:01.911047 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1454/2886] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:01.915242 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:01.924563 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8edbc-3f01-4593-af7f-a8a8044e2614 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:01.929756 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:01.930429 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.930709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.930983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.931688 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:31:01.931990 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:01.933577 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:01.945733 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1433/2887] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:31:01.950038 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:01.959085 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922b62-0ec1-4f65-9f9f-151f67f59080 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:01.963680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:01.964296 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:01.964575 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:01.964847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:01.965513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:01.967432 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:01.992606 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1455/2888] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:31:01 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:01.997014 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.007653 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fe322-ef55-42bd-ae5c-663975559f49 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.060994 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.061581 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.061876 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.062165 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.062843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.064737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.087264 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1434/2889] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:31:01 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:31:02.088420 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.099574 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101efde3-32c0-4070-a946-cfdd75c6a41a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.104761 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.105448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.105708 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.106025 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.106743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.108349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.118997 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1456/2890] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:31:02.122968 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.133484 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c6cf7-1b87-4d76-9cf4-be192f28f66e admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.138045 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31193b63-03a0-4af1-bbf8-803c76d963f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.138696 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31193b63-03a0-4af1-bbf8-803c76d963f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.138979 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31193b63-03a0-4af1-bbf8-803c76d963f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.139252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31193b63-03a0-4af1-bbf8-803c76d963f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.139960 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31193b63-03a0-4af1-bbf8-803c76d963f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.141534 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31193b63-03a0-4af1-bbf8-803c76d963f4 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.151443 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1435/2891] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:31:02.155419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.165257 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6d44-d772-41ec-914f-18d24ceded25 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.169790 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.170676 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.170956 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.171228 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] PATH_INFO: `/v3/projects/4fe2fe732be342b392a4deeeca405d97/users/97e91de810ee4b77be20bd9b5e5645f0/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.185616 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe2fe732be342b392a4deeeca405d97, user_id=97e91de810ee4b77be20bd9b5e5645f0, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.188309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.201754 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1457/2892] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:31:02 2022] PUT /identity/v3/projects/4fe2fe732be342b392a4deeeca405d97/users/97e91de810ee4b77be20bd9b5e5645f0/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:02.212506 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.212797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.213125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.239657 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] MFA Rules not processed for user `97e91de810ee4b77be20bd9b5e5645f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:02.240846 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:02.305818 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1436/2893] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:02.317542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.319497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:02.376749 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba4b4-a109-4f5d-8e2e-e972af196524 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.380688 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370f2d-da2c-4c23-9cc1-2916bc8459c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.381329 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370f2d-da2c-4c23-9cc1-2916bc8459c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.381617 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370f2d-da2c-4c23-9cc1-2916bc8459c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.381918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370f2d-da2c-4c23-9cc1-2916bc8459c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.390039 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370f2d-da2c-4c23-9cc1-2916bc8459c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.391475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370f2d-da2c-4c23-9cc1-2916bc8459c3 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.400652 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1458/2894] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:02.420453 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.480989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bb5e-7487-4a6c-9f7b-3af3efc3a833 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.485601 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.486492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.486781 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.487063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] PATH_INFO: `/v3/users/97e91de810ee4b77be20bd9b5e5645f0` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.489097 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e91de810ee4b77be20bd9b5e5645f0)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.491050 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.534368 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e91de810ee4b77be20bd9b5e5645f0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:02.541652 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e91de810ee4b77be20bd9b5e5645f0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:02.554075 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e91de810ee4b77be20bd9b5e5645f0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:02.554740 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e91de810ee4b77be20bd9b5e5645f0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:02.555363 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e91de810ee4b77be20bd9b5e5645f0'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:02.567396 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1437/2895] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:31:02 2022] DELETE /identity/v3/users/97e91de810ee4b77be20bd9b5e5645f0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:02.571741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.572036 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.572318 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.589258 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:02.590497 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:02.647222 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1459/2896] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:02.657161 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.658564 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:02.718572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989380d-0ae7-441f-84a6-9f5a6b7f5f49 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.722256 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44576099-9e90-425c-9640-8b1bdb2434b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.723538 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44576099-9e90-425c-9640-8b1bdb2434b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.723824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44576099-9e90-425c-9640-8b1bdb2434b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.724101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44576099-9e90-425c-9640-8b1bdb2434b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.732824 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44576099-9e90-425c-9640-8b1bdb2434b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.734371 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44576099-9e90-425c-9640-8b1bdb2434b6 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.743724 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1438/2897] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:02.996017 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.997452 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:03.012365 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f81512-fe98-4ef7-a521-b0f70ff5c546 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.017779 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.018596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.018884 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.019869 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] PATH_INFO: `/v3/projects/4fe2fe732be342b392a4deeeca405d97` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.021607 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe2fe732be342b392a4deeeca405d97)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.023596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.069968 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe2fe732be342b392a4deeeca405d97', 'request_id': 'req-fab3c300-9249-4666-9be7-e6e36a5cf3e0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.076441 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe2fe732be342b392a4deeeca405d97', 'request_id': 'req-fab3c300-9249-4666-9be7-e6e36a5cf3e0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.082946 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe2fe732be342b392a4deeeca405d97', 'request_id': 'req-fab3c300-9249-4666-9be7-e6e36a5cf3e0'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.092748 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] The token cache is being invalidate because project 4fe2fe732be342b392a4deeeca405d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:31:03.093028 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.093639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-fab3c300-9249-4666-9be7-e6e36a5cf3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.095174 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1460/2898] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:31:02 2022] DELETE /identity/v3/projects/4fe2fe732be342b392a4deeeca405d97 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:31:03.101039 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.101646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.101646 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.120421 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:03.121612 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:03.180009 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1439/2899] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:03.187863 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.188363 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.188486 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.206628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:03.208271 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:03.216374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1461/2900] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:03.221982 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.231983 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7792fc-9484-4b3f-9df3-016e36e1fe62 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.236507 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.237149 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.237427 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.237701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.239240 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:31:03.239553 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.241152 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.252998 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1440/2901] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:31:03.257597 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.266550 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736345db-09d5-4b6e-91c2-a78104ad23c8 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.272011 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.272911 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.273196 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.273468 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.274471 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.276382 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.303259 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1462/2902] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:31:03 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:31:03.307299 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.317243 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22fa6f-646b-411b-8bfc-40e6b5e26232 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.372036 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.372622 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.372905 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.373183 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.373877 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.375796 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.395306 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1441/2903] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:31:03 2022] POST /identity/v3/users => generated 281 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:03.399864 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.411035 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89941c-2485-4596-a203-5640c79f3167 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.415782 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.416436 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.416716 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.416990 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.417705 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.419332 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.430475 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1463/2904] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:31:03.434348 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.444225 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb0a0d-a75e-4095-abae-77f2058be372 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.448863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0302e-5bec-457a-a034-c95bf6a3fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.449554 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0302e-5bec-457a-a034-c95bf6a3fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.449843 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0302e-5bec-457a-a034-c95bf6a3fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.450166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0302e-5bec-457a-a034-c95bf6a3fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.450880 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0302e-5bec-457a-a034-c95bf6a3fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.452478 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0302e-5bec-457a-a034-c95bf6a3fd51 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.462938 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1442/2905] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:31:03.466967 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.477604 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a6a3-0988-40c9-8fd3-0d2be0f69cc7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.482253 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.483118 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.483395 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.483666 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] PATH_INFO: `/v3/projects/0b9c056b829c4fbf93be7577a22079fa/users/ef29780bab7b4a7c8d16c6b0653d3774/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.497485 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9c056b829c4fbf93be7577a22079fa, user_id=ef29780bab7b4a7c8d16c6b0653d3774, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.500171 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.512890 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1464/2906] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:31:03 2022] PUT /identity/v3/projects/0b9c056b829c4fbf93be7577a22079fa/users/ef29780bab7b4a7c8d16c6b0653d3774/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:03.523313 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.523611 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.523897 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.551063 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] MFA Rules not processed for user `ef29780bab7b4a7c8d16c6b0653d3774`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:03.552277 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:03.613662 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1443/2907] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:03.644517 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.646295 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:03.700007 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c417a-e771-4940-8fa5-b9ee26761d73 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.703548 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04434f-07a0-4e61-886c-6a355e7378d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.704183 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04434f-07a0-4e61-886c-6a355e7378d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.704458 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04434f-07a0-4e61-886c-6a355e7378d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.704728 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04434f-07a0-4e61-886c-6a355e7378d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.713389 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04434f-07a0-4e61-886c-6a355e7378d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.714852 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04434f-07a0-4e61-886c-6a355e7378d1 service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.723856 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1465/2908] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:03.737572 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.798101 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ecd3-c4b6-45c3-b33f-d0aee391f73a None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:03.802815 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:03.803678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.803965 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.804246 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] PATH_INFO: `/v3/users/ef29780bab7b4a7c8d16c6b0653d3774` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.805441 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef29780bab7b4a7c8d16c6b0653d3774)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:03.807383 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:03.852425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef29780bab7b4a7c8d16c6b0653d3774'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.858672 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef29780bab7b4a7c8d16c6b0653d3774'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.870073 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef29780bab7b4a7c8d16c6b0653d3774'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.870729 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef29780bab7b4a7c8d16c6b0653d3774'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.871341 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef29780bab7b4a7c8d16c6b0653d3774'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:03.883567 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1444/2909] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:31:03 2022] DELETE /identity/v3/users/ef29780bab7b4a7c8d16c6b0653d3774 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:03.888058 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:03.888344 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:03.888620 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:03.906223 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:03.907407 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:03.964199 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1466/2910] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:03.973786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:03.975181 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:04.031709 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ad58-de9c-4a20-8c6e-c4d245c6b5a7 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.035482 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f626e0-a9ab-4ece-8d8b-1d5e15aada67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.036123 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f626e0-a9ab-4ece-8d8b-1d5e15aada67 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.036411 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f626e0-a9ab-4ece-8d8b-1d5e15aada67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.036692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f626e0-a9ab-4ece-8d8b-1d5e15aada67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.045588 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f626e0-a9ab-4ece-8d8b-1d5e15aada67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.047043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f626e0-a9ab-4ece-8d8b-1d5e15aada67 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.056667 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1445/2911] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:04.321462 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.323016 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:04.336632 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee17aaf-e885-4614-9a6b-624f91033398 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.341300 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.342245 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.342551 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.342847 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] PATH_INFO: `/v3/projects/0b9c056b829c4fbf93be7577a22079fa` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.344621 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9c056b829c4fbf93be7577a22079fa)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.346683 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.394889 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9c056b829c4fbf93be7577a22079fa', 'request_id': 'req-7582b6c4-7d6f-4079-9bf7-da22b2133a66'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:04.402513 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9c056b829c4fbf93be7577a22079fa', 'request_id': 'req-7582b6c4-7d6f-4079-9bf7-da22b2133a66'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:04.408585 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9c056b829c4fbf93be7577a22079fa', 'request_id': 'req-7582b6c4-7d6f-4079-9bf7-da22b2133a66'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:04.418609 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] The token cache is being invalidate because project 0b9c056b829c4fbf93be7577a22079fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:31:04.418898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:04.419554 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-7582b6c4-7d6f-4079-9bf7-da22b2133a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:04.421075 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1467/2912] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:31:04 2022] DELETE /identity/v3/projects/0b9c056b829c4fbf93be7577a22079fa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:04.427504 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.428017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.428128 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.446684 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:04.447884 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:04.507395 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1446/2913] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:04.515349 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.515625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.515903 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.534128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:04.535834 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:04.543628 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1468/2914] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:04.547734 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.558216 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aa6f9-f071-46ad-a70e-6a1c2e3b33ca None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.563064 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.563708 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.563985 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.564262 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.564966 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:31:04.565270 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.566974 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.578153 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1447/2915] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:31:04.582347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.591326 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dbc20-cb6c-464f-9c5c-ba3bd7301f5f None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.596005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.596647 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.596930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.597758 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.598457 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.600358 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.625677 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1469/2916] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:31:04 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:04.630017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.639845 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdd24-a20f-4e82-9398-3a4b9baf4105 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.693839 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.694459 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.694757 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.695010 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.695678 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.697575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.716644 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1448/2917] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:31:04 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:04.720814 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.731374 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c238b9-55d8-4b63-9750-4a61838d2ebb admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.735978 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.736629 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.736910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.737185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.740651 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.741264 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.751337 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1470/2918] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:31:04.755207 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.764702 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabfeb5-d3d5-4f8b-affa-7c92940d7376 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.769212 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7eb2-2cd9-41ce-8088-7e0ccccb4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.769871 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7eb2-2cd9-41ce-8088-7e0ccccb4314 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.770158 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7eb2-2cd9-41ce-8088-7e0ccccb4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.770433 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7eb2-2cd9-41ce-8088-7e0ccccb4314 admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.771148 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7eb2-2cd9-41ce-8088-7e0ccccb4314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.772711 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7eb2-2cd9-41ce-8088-7e0ccccb4314 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.782620 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1449/2919] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:31:04.787108 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.796596 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc00646-851c-4caf-861a-5c87cf230cc7 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:04.801872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:04.802741 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.803022 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.803298 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] PATH_INFO: `/v3/projects/8516b57d556d4d8f933ba4290f3c3830/users/8e627bef12d0444295d482674b2e022a/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.817918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8516b57d556d4d8f933ba4290f3c3830, user_id=8e627bef12d0444295d482674b2e022a, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:04.820586 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:04.833014 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1471/2920] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:31:04 2022] PUT /identity/v3/projects/8516b57d556d4d8f933ba4290f3c3830/users/8e627bef12d0444295d482674b2e022a/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:04.844107 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:04.844400 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:04.844681 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:04.872992 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] MFA Rules not processed for user `8e627bef12d0444295d482674b2e022a`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:04.874252 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:04.935512 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1450/2921] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:04.946153 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:04.947936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:05.002185 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b234bb0-c6cd-44df-8486-e25e54ff2f08 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:05.006347 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c59f23-a776-4003-ac09-9c2358410a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:05.006982 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c59f23-a776-4003-ac09-9c2358410a4e service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:05.007262 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c59f23-a776-4003-ac09-9c2358410a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:05.007535 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c59f23-a776-4003-ac09-9c2358410a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:05.015511 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c59f23-a776-4003-ac09-9c2358410a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:05.016936 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c59f23-a776-4003-ac09-9c2358410a4e service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:05.026451 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1472/2922] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:14.757210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:14.817214 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e190-8077-45ab-b38f-339923b5a672 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:14.821591 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:14.822485 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:14.822769 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:14.823044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] PATH_INFO: `/v3/users/8e627bef12d0444295d482674b2e022a` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:14.824219 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e627bef12d0444295d482674b2e022a)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:14.826151 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:14.871797 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e627bef12d0444295d482674b2e022a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:14.881346 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e627bef12d0444295d482674b2e022a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:14.892664 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e627bef12d0444295d482674b2e022a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:14.893278 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e627bef12d0444295d482674b2e022a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:14.894108 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e627bef12d0444295d482674b2e022a'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:14.906136 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1451/2923] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:31:14 2022] DELETE /identity/v3/users/8e627bef12d0444295d482674b2e022a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:14.910930 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:14.911425 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:14.911531 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:14.928267 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:14.929439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:14.984582 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1473/2924] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:14.994670 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:14.996043 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:15.053044 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3e80-0f47-4fe5-b187-a9b764f3dbc5 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.056629 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3443-2d8f-418a-bbd1-c931b9afe8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.057259 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3443-2d8f-418a-bbd1-c931b9afe8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.057537 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3443-2d8f-418a-bbd1-c931b9afe8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.057809 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3443-2d8f-418a-bbd1-c931b9afe8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.066464 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a3443-2d8f-418a-bbd1-c931b9afe8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.067927 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a3443-2d8f-418a-bbd1-c931b9afe8e3 service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.077335 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1452/2925] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:15.337202 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.338611 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:15.354095 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3fc2a-57e7-4b17-b0d6-be5387fc6e09 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.358918 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.359910 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.360040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.360310 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] PATH_INFO: `/v3/projects/8516b57d556d4d8f933ba4290f3c3830` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.361477 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8516b57d556d4d8f933ba4290f3c3830)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.364499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.409935 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8516b57d556d4d8f933ba4290f3c3830', 'request_id': 'req-b269ad61-6726-4c55-bbb9-0c641d376bf8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:15.416282 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8516b57d556d4d8f933ba4290f3c3830', 'request_id': 'req-b269ad61-6726-4c55-bbb9-0c641d376bf8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:15.422492 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8516b57d556d4d8f933ba4290f3c3830', 'request_id': 'req-b269ad61-6726-4c55-bbb9-0c641d376bf8'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:15.432931 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] The token cache is being invalidate because project 8516b57d556d4d8f933ba4290f3c3830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:31:15.433221 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:15.433872 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-b269ad61-6726-4c55-bbb9-0c641d376bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:15.435419 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1474/2926] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:31:15 2022] DELETE /identity/v3/projects/8516b57d556d4d8f933ba4290f3c3830 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:15.440223 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.441096 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.441398 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.458910 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:15.460111 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:15.516827 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1453/2927] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:15.524743 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.525031 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.525309 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.543615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:15.544802 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:15.553430 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1475/2928] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:15.557524 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.567492 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b5d4f-ea1f-4645-a341-7c16f3f4a4a5 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.571958 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.572600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.572879 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.573154 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] PATH_INFO: `/v3/domains` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.573882 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:31:15.574185 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.575763 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.590651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1454/2929] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Mar 8 15:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:31:15.591615 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.601650 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786e0e8-626a-4338-a24e-fe037d8fb629 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.606578 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.607224 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.607509 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.607810 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.608484 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.610426 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.636439 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1476/2930] 10.222.0.30 () {60 vars in 1152 bytes} [Tue Mar 8 15:31:15 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:31:15.640791 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.650891 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9643-27ae-47e9-a921-058208f2cd99 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.703697 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.704345 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.704625 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.704893 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] PATH_INFO: `/v3/users` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.705566 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.707600 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.730533 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1455/2931] 10.222.0.30 () {60 vars in 1143 bytes} [Tue Mar 8 15:31:15 2022] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:31:15.732005 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.742844 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0ab0-8f8a-4716-9948-7f4d1e579b2a admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.748177 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.748845 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.749128 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.749408 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.750160 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.751763 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.764639 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1477/2932] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:31:15.768692 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.779046 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f150c-7cab-495c-912e-2615aec8632a admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.783651 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775354b1-e354-4c4e-b5fd-6713873075ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.784863 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775354b1-e354-4c4e-b5fd-6713873075ef admin admin] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.785145 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775354b1-e354-4c4e-b5fd-6713873075ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.785423 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775354b1-e354-4c4e-b5fd-6713873075ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.786166 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775354b1-e354-4c4e-b5fd-6713873075ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.787737 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775354b1-e354-4c4e-b5fd-6713873075ef admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.797245 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1456/2933] 10.222.0.30 () {58 vars in 1121 bytes} [Tue Mar 8 15:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:31:15.801831 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.811479 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55974e-2f84-4429-b04d-51746cf81d41 admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:15.816048 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:15.816908 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.817182 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.817450 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] PATH_INFO: `/v3/projects/a91bbc69e68249e28fc70a5b6321d18e/users/d3bbdce7ae3546db8a019b74ea9650f8/roles/76557cef496747999b703b4bc4b6b5d7` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.831448 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91bbc69e68249e28fc70a5b6321d18e, user_id=d3bbdce7ae3546db8a019b74ea9650f8, role_id=76557cef496747999b703b4bc4b6b5d7)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:15.834094 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:15.846364 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1478/2934] 10.222.0.30 () {60 vars in 1482 bytes} [Tue Mar 8 15:31:15 2022] PUT /identity/v3/projects/a91bbc69e68249e28fc70a5b6321d18e/users/d3bbdce7ae3546db8a019b74ea9650f8/roles/76557cef496747999b703b4bc4b6b5d7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:15.856848 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] REQUEST_METHOD: `POST` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:15.857139 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:15.857417 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:15.884547 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.auth.core [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] MFA Rules not processed for user `d3bbdce7ae3546db8a019b74ea9650f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:15.885752 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:15.950360 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1457/2935] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:15.961570 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:15.963263 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:16.019898 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfe4d3-4268-487b-ad7d-b8db43e39b4b admin admin] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:16.024067 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680beadc-3348-49e8-8873-5d4af9fe73fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa371f194b149bd86f53b5de40bb719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:16.024773 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680beadc-3348-49e8-8873-5d4af9fe73fa service cinder] REQUEST_METHOD: `GET` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:16.025082 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680beadc-3348-49e8-8873-5d4af9fe73fa service cinder] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:16.025362 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680beadc-3348-49e8-8873-5d4af9fe73fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:16.033949 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680beadc-3348-49e8-8873-5d4af9fe73fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:16.036040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680beadc-3348-49e8-8873-5d4af9fe73fa service cinder] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:16.044984 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1479/2936] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:35.414532 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:35.474802 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cddec-5043-47cc-8f2c-c92ee7a02219 None None] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:35.479351 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:35.480210 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:35.480495 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:35.480775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] PATH_INFO: `/v3/users/d3bbdce7ae3546db8a019b74ea9650f8` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:35.482003 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bbdce7ae3546db8a019b74ea9650f8)` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:35.483916 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:35.529991 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bbdce7ae3546db8a019b74ea9650f8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:35.536701 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bbdce7ae3546db8a019b74ea9650f8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:35.548387 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bbdce7ae3546db8a019b74ea9650f8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:35.549017 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bbdce7ae3546db8a019b74ea9650f8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:35.549619 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.notifications [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bbdce7ae3546db8a019b74ea9650f8'} {{(pid=91157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:35.562070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1458/2937] 10.222.0.30 () {58 vars in 1223 bytes} [Tue Mar 8 15:31:35 2022] DELETE /identity/v3/users/d3bbdce7ae3546db8a019b74ea9650f8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:31:35.566533 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] REQUEST_METHOD: `POST` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:35.567040 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:35.567169 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:35.584825 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.auth.core [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] MFA Rules not processed for user `0bd37b850c884d06a49d5c8c55a39f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:35.586066 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:35.642653 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1480/2938] 10.222.0.30 () {58 vars in 957 bytes} [Tue Mar 8 15:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:35.652908 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:35.654328 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:35.711786 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941e0d1-ad05-4d33-8d06-36d96b76f502 admin admin] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:35.715425 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e45b81aa59fd4b26bc1434c9191c20ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:35.716070 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:35.716355 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:35.716635 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:35.725575 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:35.728129 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:35.737514 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1459/2939] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:35.997614 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] Authenticating user token {{(pid=91156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:35.999129 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.fernet_utils [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:36.011137 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51cdfc-d2c2-4113-a514-570c4310fa69 None None] Validating token access rules against request {{(pid=91156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:36.016130 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd37b850c884d06a49d5c8c55a39f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419bd55459f54e4a803dd03c0fde0573', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:36.016680 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:36.016959 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:36.017238 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] PATH_INFO: `/v3/projects/a91bbc69e68249e28fc70a5b6321d18e` {{(pid=91156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:36.018542 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91bbc69e68249e28fc70a5b6321d18e)` {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:36.020499 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] RBAC: Authorization granted {{(pid=91156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:36.077522 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91bbc69e68249e28fc70a5b6321d18e', 'request_id': 'req-d898e329-5f1b-4d8e-a8c5-4e57b801c471'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:36.084756 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91bbc69e68249e28fc70a5b6321d18e', 'request_id': 'req-d898e329-5f1b-4d8e-a8c5-4e57b801c471'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:36.092190 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91bbc69e68249e28fc70a5b6321d18e', 'request_id': 'req-d898e329-5f1b-4d8e-a8c5-4e57b801c471'} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:36.103125 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] The token cache is being invalidate because project a91bbc69e68249e28fc70a5b6321d18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:31:36.103409 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:36.104055 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: DEBUG keystone.notifications [None req-d898e329-5f1b-4d8e-a8c5-4e57b801c471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:31:36.105625 dv-cinder-830095-2-iscsi devstack@keystone.service[91156]: [pid: 91156|app: 0|req: 1481/2940] 10.222.0.30 () {58 vars in 1232 bytes} [Tue Mar 8 15:31:35 2022] DELETE /identity/v3/projects/a91bbc69e68249e28fc70a5b6321d18e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:34:40.046125 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] Authenticating user token {{(pid=91157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:34:40.047616 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:34:40.136585 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2993a9-3d03-46e4-83de-726e7f87a13d service neutron] Validating token access rules against request {{(pid=91157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:34:40.194102 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5f9bb835104f1c95d0ccc6ddd02de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a59ee8f893149c7849213e5bbc06593', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:34:40.194775 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] REQUEST_METHOD: `GET` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:34:40.195058 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] SCRIPT_NAME: `/identity` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:34:40.195340 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:34:40.197077 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.fernet_utils [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:34:40.207989 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:34:40.210135 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43d027-fd0b-459a-98d9-08eaf8064460 service placement] RBAC: Authorization granted {{(pid=91157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:34:40.219760 dv-cinder-830095-2-iscsi devstack@keystone.service[91157]: [pid: 91157|app: 0|req: 1460/2941] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Mar 8 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)